-- Logs begin at Sat 2022-09-10 13:35:07 UTC, end at Sat 2022-09-10 14:37:11 UTC. -- Sep 10 14:05:09.031670 dv-cinder-856901-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 14:05:09.040180 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 14:05:09 2022] *** Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: nodename: dv-cinder-856901-1-iscsi Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: machine: x86_64 Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: clock source: unix Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: pcre jit disabled Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: detected number of CPU cores: 4 Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: current working directory: / Sep 10 14:05:09.042165 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: detected binary path: /usr/bin/uwsgi-core Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: your processes number limit is 47680 Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: your memory page size is 4096 bytes Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: detected max file descriptor number: 2048 Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: lock engine: pthread robust mutexes Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: thunder lock: enabled Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 14:05:09.042877 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 14:05:09.081936 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: Python main interpreter initialized at 0x558f638789c0 Sep 10 14:05:09.081936 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: python threads support enabled Sep 10 14:05:09.081936 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: your server socket listen backlog is limited to 100 connections Sep 10 14:05:09.081936 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: your mercy for graceful operations on workers is 90 seconds Sep 10 14:05:09.082315 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 14:05:09.082398 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: *** Operational MODE: preforking *** Sep 10 14:05:09.082598 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: *** uWSGI is running in multiple interpreter mode *** Sep 10 14:05:09.082598 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: spawned uWSGI master process (pid: 105573) Sep 10 14:05:09.082799 dv-cinder-856901-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 10 14:05:09.083350 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: spawned uWSGI worker 1 (pid: 105574, cores: 1) Sep 10 14:05:09.083704 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: spawned uWSGI worker 2 (pid: 105575, cores: 1) Sep 10 14:05:09.083886 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 14:05:09.744516 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 14:05:09.751093 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 14:05:10.837890 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:05:10.837890 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: from cryptography.utils import int_from_bytes Sep 10 14:05:10.838555 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:05:10.838555 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: from cryptography.utils import int_from_bytes Sep 10 14:05:10.838691 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:05:10.838691 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: from cryptography.utils import int_from_bytes Sep 10 14:05:10.839096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:05:10.839096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: from cryptography.utils import int_from_bytes Sep 10 14:05:13.338347 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 14:05:13.339015 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 14:05:13.339120 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 14:05:13.339467 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 14:05:13.339724 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 14:05:13.340107 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.340425 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.340743 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.340973 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 14:05:13.341368 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.341458 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 14:05:13.341540 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.341667 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.341765 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 14:05:13.341984 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.342155 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 14:05:13.342391 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.342483 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 14:05:13.342717 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.342829 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.342974 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.343147 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.343286 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.343484 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.343644 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856901-1-iscsi {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.343800 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.343957 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.344126 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.344268 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.344456 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.344570 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.344731 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.344881 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345065 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345166 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345363 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345491 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345619 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345794 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.345928 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.346245 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856901-1-iscsi {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.346339 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.346559 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.347527 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.347624 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.347719 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.347811 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.347893 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348027 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348110 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348188 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348577 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348670 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348757 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348843 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.348929 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349094 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349178 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349395 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349481 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349693 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349784 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.349996 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.350100 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856901-1-iscsi {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.350324 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.350411 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.350629 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.350722 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.350931 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351016 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351241 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351373 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351566 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351699 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351887 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.351996 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.352190 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.352309 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.352576 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856901-1-iscsi {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.352680 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.352883 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.352986 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.353186 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.353272 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.353490 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.353575 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.353845 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.353932 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.354172 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.354268 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.354469 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.354569 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.354774 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.354866 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.355083 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.355168 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.355384 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.355513 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.355727 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.355815 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356027 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356119 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356275 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356370 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356583 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356669 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356898 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.356990 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.357213 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.357306 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.357518 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.357604 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.358279 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.358423 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.358511 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.358831 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.358917 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.359147 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.359235 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.359492 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.359601 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.359777 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.359874 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360083 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360169 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360388 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360486 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360693 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360787 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.360945 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361039 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361194 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361288 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361507 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361594 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.361930 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.362134 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.362229 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.362437 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.362531 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.362739 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.362826 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363041 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363128 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363347 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363462 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363670 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363770 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.363974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364061 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364276 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364368 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364590 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364897 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.364987 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.365214 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.365300 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.365517 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.365615 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.365828 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.365913 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.366129 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.366229 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.366434 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.366530 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.366741 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.366833 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367067 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367159 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367369 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367502 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367643 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367769 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.367942 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368082 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368242 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368398 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368556 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368700 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368859 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.368999 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.369163 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.369300 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.369467 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.369611 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.369767 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.369940 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370070 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370238 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370374 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370473 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370677 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370764 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.370981 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.371070 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.371283 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.371369 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.371611 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.371721 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.371918 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372025 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372220 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372306 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372517 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372610 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372817 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.372903 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.373117 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.373201 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.374009 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.374119 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.374466 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.374551 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.374778 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.374910 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.375089 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.375213 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.375401 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.375552 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.375762 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.375851 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.376069 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.376164 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.376375 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.376461 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.376696 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.376792 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377001 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377096 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377306 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377392 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377609 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377704 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.377915 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378017 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378217 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378302 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378534 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378643 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378833 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.378937 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.379133 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.379218 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.379475 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.379580 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.379767 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.379853 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380067 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380151 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380369 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380458 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380669 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380762 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.380969 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381053 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381270 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381355 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381563 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381648 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381860 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.381960 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.382160 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.382259 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.382458 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.382544 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.382756 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.382841 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383053 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383147 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383350 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383437 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383668 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383757 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.383966 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.384060 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.384260 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.384346 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.384554 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.384638 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.384846 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.384953 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.385155 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.385241 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.385469 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.385561 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.385772 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.385890 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.386074 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.386207 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.386372 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.386520 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.386684 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:05:13.386834 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.387012 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.387157 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.387337 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.387487 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.387705 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.387793 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.388016 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.388103 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.388345 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.388433 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.388673 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.388759 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.389025 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.389136 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.389463 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.389557 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.389887 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.389973 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.390212 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.390313 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.390525 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.390671 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.390844 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.390933 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.391164 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.391251 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.391500 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.391587 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.391817 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.391904 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.392142 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.392295 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.392458 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.392618 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.392773 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.392861 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.393088 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.393182 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.393396 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.393491 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.393702 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.393788 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394011 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394110 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394319 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394414 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394626 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394710 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.394958 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.395042 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.395271 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.395366 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.395613 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.395713 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.395922 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396014 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396237 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396323 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396541 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396635 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396845 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.396931 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.397148 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.397236 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.397455 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.397552 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.397763 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.397851 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.398075 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.398162 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.398387 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.398472 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.398692 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.398777 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399002 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399095 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399307 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399398 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399633 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399734 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.399938 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400062 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400242 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400329 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400546 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400641 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400846 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.400943 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.401151 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.401237 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.401453 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.401548 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.401760 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.401847 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402064 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402149 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402375 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402482 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402680 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402768 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.402984 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403072 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403287 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403388 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403606 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403697 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403905 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.403991 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.404201 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.404290 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.404502 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.405076 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.405366 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.405490 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.405734 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406033 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406119 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406339 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406425 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406661 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406758 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.406972 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.407071 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.407276 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.407364 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.407613 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.407713 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.407918 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408012 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408222 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408308 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408528 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408616 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408836 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.408932 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.409140 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.409224 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.409441 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.409529 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.409746 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.409833 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410058 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410190 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410359 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410455 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410664 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410748 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.410965 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.411063 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.411267 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.411353 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.411600 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.411699 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.411907 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412010 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412214 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412309 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412524 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412631 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412826 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.412922 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.413129 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.413214 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.413427 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.413523 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.413728 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.413824 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414029 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414116 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414335 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414422 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414636 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414737 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.414936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415023 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415237 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415331 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415567 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415660 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415867 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.415952 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.416171 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.416268 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.416468 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.416557 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.416763 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.416855 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417059 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417143 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417356 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417449 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417654 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417746 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.417951 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418046 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418249 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418335 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418547 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418633 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418843 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.418943 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.419160 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.419253 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.419483 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.419574 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.419785 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.419881 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.420082 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.420243 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.420507 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.420627 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.420812 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.421131 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.421293 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.421661 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.421795 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.422214 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.422325 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.422534 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.422825 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.423179 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.423404 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.423531 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.423840 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.424022 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.424167 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.424474 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.424603 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.424791 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.425132 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.425246 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.425471 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.425708 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.425808 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.426104 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.426232 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.426418 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.426718 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.427027 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.427165 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.427341 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.427673 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.427802 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.427982 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.428150 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.428299 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.428598 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.428689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.428911 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.429130 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.429230 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.429457 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.429555 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.429794 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.429880 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.430114 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.430208 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.430414 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.430518 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.430725 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.430856 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.431045 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.431131 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.431372 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.431483 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.431710 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.431797 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.432022 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.432109 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.432342 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.432445 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.432651 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433220 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433352 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433461 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433583 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433741 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433853 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.433973 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434092 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434209 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434328 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434443 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434552 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434659 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434772 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.434887 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.435003 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.435111 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.435301 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.435425 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.435645 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.435778 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.436504 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.436628 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437050 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437349 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437470 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437588 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437697 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437838 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.437954 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.438176 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.438287 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.438490 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.438579 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.438802 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.438888 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.439116 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.439210 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.439464 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.439570 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.439780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.439868 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440088 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440183 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440390 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440474 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440689 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440777 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.440987 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.441073 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.441289 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.441375 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.441600 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.441697 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.441905 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442004 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442209 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442295 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442509 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442595 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442813 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.442900 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.443117 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.443225 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.443420 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.443639 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.443742 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.444049 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.444189 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.444358 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.444663 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.444748 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.444971 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.445277 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.445369 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.445583 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.445888 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.445983 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.446205 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.446292 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.446513 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.446600 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.446820 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.446916 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.447125 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.447212 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.447426 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.447544 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.447754 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.447859 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.448066 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.448195 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.448422 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.448645 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.448733 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.448976 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.449064 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.449288 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.449382 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.449603 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.449702 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.449923 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450009 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450238 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450334 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450542 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450629 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450852 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.450939 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.451155 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.451241 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.452068 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.452171 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.452586 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.452681 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.453013 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.453226 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.453318 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.453607 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.453817 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.453905 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.454177 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.454264 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.454490 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.454589 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.454794 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.454893 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.455095 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.455190 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.455395 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.455514 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.455723 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.455823 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456031 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456116 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456333 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456419 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456632 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456716 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.456936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.457019 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.457248 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.457335 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.457551 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.457821 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.457917 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.458138 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.458232 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.458439 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.458543 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.458752 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.458839 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.459064 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.459150 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.459394 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.459531 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.459744 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.459838 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460067 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460161 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460373 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460466 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460671 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460756 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.460976 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461071 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461275 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461364 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461573 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461667 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461870 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.461972 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.462168 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.462261 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.462467 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.462561 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.462762 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.462856 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463065 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463150 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463501 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463688 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463793 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.463988 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464074 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464285 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464370 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464585 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464679 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464880 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.464973 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.465188 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.465272 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.465483 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.465569 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.465779 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.465864 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466080 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466166 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466373 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466459 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466669 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466757 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.466964 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.467090 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.467417 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.467538 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.467804 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.467970 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.468197 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.468319 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.468502 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.468650 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.468806 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.468992 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.469109 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.469299 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.469415 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.469603 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.469721 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.469925 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470012 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470229 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470317 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470530 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470616 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470833 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.470975 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.471137 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.471225 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.471455 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.471548 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.471762 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.471866 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472071 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472158 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472374 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472467 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472677 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472777 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.472982 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.473123 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.473524 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.473617 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.473834 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.473940 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.474132 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.474217 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.474435 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.474522 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.474736 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.474823 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475034 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475121 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475331 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475422 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475655 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475745 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.475953 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476038 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476251 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476349 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476553 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476639 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476847 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.476932 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.477157 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.477244 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.477454 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.477539 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.477755 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.477848 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478052 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478146 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478355 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478442 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478659 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478757 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.478955 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.479117 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.479273 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.479367 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.479602 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.479693 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.479903 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480003 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480201 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480289 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480503 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480590 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480801 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.480896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.481101 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.481186 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.481402 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.481487 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.481705 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.481802 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.482013 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.482098 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.482311 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.482398 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.482610 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.482713 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.483002 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.483088 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.483365 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.483621 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.483724 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.483932 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484024 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484240 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484328 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484542 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484643 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484842 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.484932 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.485141 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.485228 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.485440 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.485541 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.485741 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.485836 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486059 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486145 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486363 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486452 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486661 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486747 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.486960 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487046 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487256 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487344 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487593 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487695 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487903 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.487990 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.488206 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.488294 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.488512 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.488598 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.488817 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.488903 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.489120 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.489216 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.489424 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.489513 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.489731 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.489826 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490030 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490122 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490327 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490413 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490625 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490718 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.490929 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491015 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491228 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491312 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491548 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491680 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491849 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.491991 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.492164 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.492301 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.492472 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.492603 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.492776 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.492912 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.493090 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.493221 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.493407 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.493537 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.493726 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.493848 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494027 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494151 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494330 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494563 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494650 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494874 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.494961 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.495182 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.495283 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.495513 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.495606 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.495819 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.495914 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.496120 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.496222 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.496423 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.496509 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.496729 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.496815 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497031 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497117 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497326 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497413 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497627 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497721 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.497929 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.498016 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.498230 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.498834 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.499074 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.499245 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.499522 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.499689 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.499818 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.499996 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.500122 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.500304 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.500535 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.500625 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.500845 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.500937 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.501152 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.501298 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.501473 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.501600 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.501791 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.501909 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.502114 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.502214 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.502420 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.502508 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.502731 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.502816 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.503038 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.503137 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.503359 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.503471 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.503701 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.503798 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504001 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504097 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504311 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504395 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504612 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504699 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.504935 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505023 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505256 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505342 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505570 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505656 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505867 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.505966 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.506172 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.506290 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.506489 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.506611 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.506791 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.506925 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.507092 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.507243 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.507391 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.507588 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.507729 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.507894 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.508033 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.508198 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.508348 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.508506 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.508756 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.508845 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.509062 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.509150 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.509361 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.509448 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.509695 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.509794 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510006 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510100 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510316 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510403 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510622 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510718 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.510925 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511019 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511229 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511355 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511580 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511722 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511880 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.511969 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.512183 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.512282 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.512500 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.512595 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.512816 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.512902 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.513124 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.513212 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.513427 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.513524 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.513726 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.513820 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.514615 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.514757 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.514922 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.515219 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.515313 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.515541 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.515633 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.515875 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.515976 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.516178 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.516289 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.516493 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.516613 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.516825 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.516934 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.517152 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.517240 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.517460 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.517546 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.517792 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.517881 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.518117 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.518204 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.518421 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.518508 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.518721 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.518808 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519022 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519103 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519340 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519424 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519663 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519751 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.519962 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520047 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520266 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520351 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520566 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520653 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520863 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.520956 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.521164 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.521258 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.521470 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.521558 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.521769 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.521902 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522067 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522162 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522368 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522456 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522686 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522772 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.522987 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.523081 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.523291 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.523422 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.523624 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.523710 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.523925 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524025 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524221 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524306 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524518 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524611 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524816 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.524902 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.525146 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.525231 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.525446 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.525531 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.525759 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.525847 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.526076 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.526169 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.526393 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.526489 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.526698 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.526786 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527011 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527102 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527322 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527410 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527658 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527754 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.527965 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528053 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528274 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528370 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528672 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528882 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.528967 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.529180 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.529275 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.529485 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.529602 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.529985 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.530079 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.530343 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.530442 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.530655 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.530743 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.530964 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.531050 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.531263 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.531357 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.531588 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.531678 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.531889 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532023 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532202 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532297 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532503 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532589 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532804 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.532890 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533107 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533194 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533406 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533494 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533705 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533836 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.533996 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.534080 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.534324 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.534413 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.534623 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.534718 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.534945 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535033 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535245 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535339 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535577 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535681 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535892 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.535978 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.536202 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.536290 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.536512 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.536608 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.536822 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.536909 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.537131 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.537215 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.537436 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.537530 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.537747 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.537834 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538057 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538142 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538364 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538451 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538672 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538756 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.538979 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.539066 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.539285 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.539515 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.539620 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.539843 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.539931 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.540154 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.540243 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.540463 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.540550 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.540769 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.540856 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541077 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541166 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541386 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541485 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541690 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541777 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.541996 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.542241 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.542333 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.542552 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.542646 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.542882 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.542970 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.543201 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.543311 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.543543 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.543652 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.543861 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.543951 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.544171 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.544258 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.544480 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.544567 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.544782 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.544908 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.545087 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.545276 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.545437 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.545558 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.545744 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546045 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546130 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546364 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546459 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546676 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546811 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.546975 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.547063 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.547288 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.547374 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.547617 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.547706 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.547927 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.548151 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.548251 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.548501 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.548598 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.548817 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.548906 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.549118 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.549211 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.549426 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.549515 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.549733 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.549822 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550047 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550131 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550370 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550458 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550676 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550769 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.550979 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.551072 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.551285 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.551373 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.551615 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.551704 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.551920 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.552129 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.552217 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.552437 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.552524 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.552764 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.552851 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.553084 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.553181 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.553389 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.553474 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.553690 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.553778 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554000 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554087 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554300 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554386 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554605 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554694 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.554902 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555047 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555207 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555301 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555528 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555646 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555829 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.555916 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.556127 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.556212 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.556432 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.556528 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.556728 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.556814 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557030 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557114 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557330 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557425 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557629 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557857 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.557952 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.558202 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.558289 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.558510 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.558599 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.558829 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.558915 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.559148 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.559245 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.559459 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.559548 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.559772 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.559857 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.560084 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.560184 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.560384 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.560470 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.560684 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.561306 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.561535 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.561631 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.561846 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.562084 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.562181 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.562394 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.562482 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.562701 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563007 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563102 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563311 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563405 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563638 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563738 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.563948 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564035 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564249 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564336 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564573 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564661 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564872 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.564965 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.565173 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.565259 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.565475 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.565563 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.565782 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.565877 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566083 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566169 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566385 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566473 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566685 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566780 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.566985 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.567081 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.567288 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.567374 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.567607 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.567695 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.567911 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568010 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568209 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568296 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568511 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568597 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568816 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.568912 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.569121 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.569209 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.569426 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.569514 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.569730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.569822 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570030 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570115 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570332 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570418 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570644 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570732 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.570948 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.571035 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.571265 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.571351 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.571593 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.571683 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.571902 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.572035 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.572208 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.572294 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.572518 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.572606 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.572824 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.573052 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.573139 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.573380 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.573469 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.573697 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.573793 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.574024 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.574112 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.574351 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.574654 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.574742 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.574956 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.575043 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.575258 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.575353 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.575602 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.575694 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.575910 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.576009 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.576216 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.576305 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.576585 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.576690 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.576953 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.577150 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.577275 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.577475 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.577585 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.577789 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.577915 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.578104 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.578256 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.578413 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.578583 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.578719 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.578908 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579008 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579214 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579302 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579542 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579635 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579848 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.579952 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.580156 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.580244 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.580470 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.580557 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.580778 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.580874 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581081 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581168 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581383 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581470 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581777 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.581990 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582117 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582291 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582380 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582591 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582688 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582892 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.582986 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.583194 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.583280 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.583514 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.583605 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.583820 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.583907 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.584124 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.584211 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.584425 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.584514 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.584726 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585025 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585111 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585330 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585419 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585629 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585717 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.585929 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586016 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586235 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586325 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586537 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586624 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586836 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.586923 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.587164 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.587252 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.587495 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.587585 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.587804 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.587901 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.588125 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.588218 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.588481 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.588576 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.588754 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.588850 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589059 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589147 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589360 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589446 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589659 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589755 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.589962 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590050 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590266 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590361 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590578 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590677 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590882 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.590969 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.591181 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.591275 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.591507 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.591625 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.591813 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.591907 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.592624 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.592726 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593032 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593158 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593388 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593563 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593674 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593870 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.593971 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.594177 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.594291 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.594477 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.594612 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.594779 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.594929 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595079 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595242 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595379 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595577 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595685 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595904 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.595992 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.596214 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.596302 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.596533 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.596632 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.596841 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.596928 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.597136 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.597221 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.597434 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.597535 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.597731 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.597819 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.598040 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.598125 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.598604 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.598707 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.598916 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599011 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599228 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599317 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599555 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599659 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599875 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.599971 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.600181 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.600268 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.600498 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.600587 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.600817 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.600904 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.601128 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.601214 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.601434 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.601522 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.601760 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.601847 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602065 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602160 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602370 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602458 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602682 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602791 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.602987 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.603094 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.603230 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 14:05:13.603320 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.603603 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.603926 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.604247 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.604550 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.604871 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.605186 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.605500 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.605811 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.606118 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.606442 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.606752 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.607058 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.607362 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.607802 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.608292 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.608650 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.608961 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.609271 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.609584 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.609893 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.610216 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.610537 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.610843 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.611164 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.611506 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.611855 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.612162 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.612501 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.612827 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.613134 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.613440 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.613739 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:05:13.613975 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 14:05:13.757874 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO dbcounter [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Registered counter for database nova_api Sep 10 14:05:13.769456 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO dbcounter [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Registered counter for database nova_api Sep 10 14:05:13.777819 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105575) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:13.784427 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writer thread running {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:13.789259 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_db.sqlalchemy.engines [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:13.796301 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writer thread running {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:13.843628 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.context [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab3df0e3-6de0-42ba-8be2-84cbff7aa19d(cell1) {{(pid=105575) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 14:05:13.847621 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:05:13.848101 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:05:13.849919 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:05:13.850636 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:05:13.851084 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:05:13.853082 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:05:13.854070 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.context [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab3df0e3-6de0-42ba-8be2-84cbff7aa19d(cell1) {{(pid=105574) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 14:05:13.855069 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO dbcounter [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Registered counter for database nova_cell0 Sep 10 14:05:13.858465 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_concurrency.lockutils [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:05:13.859176 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_concurrency.lockutils [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:05:13.859637 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO dbcounter [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Registered counter for database nova_cell1 Sep 10 14:05:13.860785 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_concurrency.lockutils [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:05:13.861508 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_concurrency.lockutils [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:05:13.861956 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_concurrency.lockutils [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:05:13.864178 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_concurrency.lockutils [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:05:13.865948 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO dbcounter [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Registered counter for database nova_cell0 Sep 10 14:05:13.867630 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105575) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:13.869811 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105575) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:13.870081 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO dbcounter [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Registered counter for database nova_cell1 Sep 10 14:05:13.874842 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writer thread running {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:13.878045 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_db.sqlalchemy.engines [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:13.880155 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_db.sqlalchemy.engines [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:13.885426 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writer thread running {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:13.887618 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writer thread running {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:14.012139 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writer thread running {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:14.022586 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO dbcounter [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Registered counter for database nova_cell0 Sep 10 14:05:14.030140 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105575) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:14.034620 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO dbcounter [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Registered counter for database nova_cell0 Sep 10 14:05:14.034826 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writer thread running {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:14.043504 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG oslo_db.sqlalchemy.engines [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:05:14.048194 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writer thread running {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:05:14.376564 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: WARNING keystonemiddleware.auth_token [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:05:14.381683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: WARNING keystonemiddleware.auth_token [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:05:14.383893 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: WARNING keystonemiddleware.auth_token [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:05:14.389724 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: WARNING keystonemiddleware.auth_token [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:05:14.729209 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: WARNING keystonemiddleware.auth_token [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:05:14.735783 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: WARNING keystonemiddleware.auth_token [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:05:14.738853 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: WARNING keystonemiddleware.auth_token [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:05:14.741072 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558f638789c0 pid: 105575 (default app) Sep 10 14:05:14.743135 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:05:14.744348 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Sep 10 14:05:14.744755 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Sep 10 14:05:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:05:14.744851 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: WARNING keystonemiddleware.auth_token [None req-9bb608be-6fda-47d6-84bf-b830356b8437 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:05:14.750841 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558f638789c0 pid: 105574 (default app) Sep 10 14:06:36.330839 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:36.331906 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 10 14:06:36.332306 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:06:36.345267 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_api:SELECT=3 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:36.346255 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_cell0:SELECT=3 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:36.347085 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_cell1:SELECT=3 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:36.349062 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:37.352275 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-46c7286a-0535-46da-86e5-6e106c7bbce0 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:37.385193 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-46c7286a-0535-46da-86e5-6e106c7bbce0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.046108 Sep 10 14:06:37.385929 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 10 14:06:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:06:40.026753 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:40.028469 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-4fe68004-4273-4a1e-ba11-5b477b7e4191 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Sep 10 14:06:40.031502 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:06:40.482631 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-3d9c74ba-4325-447d-bc02-1ea47875cd6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "ram": 256}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:40.530486 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-3d9c74ba-4325-447d-bc02-1ea47875cd6a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494950 Sep 10 14:06:40.531034 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:06:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:06:40.545971 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_api:SELECT=3 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:40.546804 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_cell0:SELECT=3 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:40.549278 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_cell1:SELECT=3 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:40.549536 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:06:40.766340 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-a86f4f35-ece6-472d-8efa-899ccfbec66f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:40.836776 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-a86f4f35-ece6-472d-8efa-899ccfbec66f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.296919 Sep 10 14:06:40.837468 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 10 14:06:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:06:43.458172 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-3d9c74ba-4325-447d-bc02-1ea47875cd6a admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:43.459186 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-3d9c74ba-4325-447d-bc02-1ea47875cd6a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 10 14:06:43.459634 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:06:44.146630 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-27113a63-0671-4e53-bff3-7e82526eaa90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:44.189377 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-27113a63-0671-4e53-bff3-7e82526eaa90 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.722577 Sep 10 14:06:44.191065 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:06:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 14:06:44.203782 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-af68b41b-670c-44d9-b813-538ecf38844b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:44.244891 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-af68b41b-670c-44d9-b813-538ecf38844b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045366 Sep 10 14:06:44.245834 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 10 14:06:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:06:46.881933 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-27113a63-0671-4e53-bff3-7e82526eaa90 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:46.883005 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-27113a63-0671-4e53-bff3-7e82526eaa90 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Sep 10 14:06:46.883409 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:06:47.312195 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-fb3e509c-9828-47ec-a2e7-573a0beea81d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "swap": 0, "vcpus": 1}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:47.337378 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-fb3e509c-9828-47ec-a2e7-573a0beea81d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446993 Sep 10 14:06:47.337933 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:06:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:06:47.353840 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-149dacff-8dc8-4ca4-93b5-1dc2715cb32d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:47.384519 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-149dacff-8dc8-4ca4-93b5-1dc2715cb32d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036870 Sep 10 14:06:47.385462 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 10 14:06:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:06:50.044581 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-fb3e509c-9828-47ec-a2e7-573a0beea81d admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:50.045495 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-fb3e509c-9828-47ec-a2e7-573a0beea81d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 10 14:06:50.045894 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:06:50.482550 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-ac3ea058-a9f8-4d67-8f8c-f2fecb56d68a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:50.501924 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-ac3ea058-a9f8-4d67-8f8c-f2fecb56d68a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449707 Sep 10 14:06:50.502642 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:06:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:06:50.515525 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-4a28c9af-8e5b-4fd3-a76d-9009964969b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:50.544334 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-4a28c9af-8e5b-4fd3-a76d-9009964969b8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033137 Sep 10 14:06:50.545007 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 10 14:06:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:06:53.214171 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-ac3ea058-a9f8-4d67-8f8c-f2fecb56d68a admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:53.216081 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-ac3ea058-a9f8-4d67-8f8c-f2fecb56d68a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Sep 10 14:06:53.216577 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:06:53.648654 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-fc78d424-e3d0-431a-a649-eb96f10e7845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:53.668757 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-fc78d424-e3d0-431a-a649-eb96f10e7845 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446036 Sep 10 14:06:53.669408 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:06:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 14:06:53.681494 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-a71de9e6-4da9-4c49-821f-d8e702518f56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:06:53.706949 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-a71de9e6-4da9-4c49-821f-d8e702518f56 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029005 Sep 10 14:06:53.707558 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 10 14:06:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:06:56.512770 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-fc78d424-e3d0-431a-a649-eb96f10e7845 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:56.513846 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-fc78d424-e3d0-431a-a649-eb96f10e7845 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002317 Sep 10 14:06:56.514246 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:06:56.962510 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-bda69bcb-d289-40ff-b771-f6f6561d0c80 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:56.988783 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-bda69bcb-d289-40ff-b771-f6f6561d0c80 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466976 Sep 10 14:06:56.989331 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 10 14:06:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:06:59.664141 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-fc78d424-e3d0-431a-a649-eb96f10e7845 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:06:59.665070 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-fc78d424-e3d0-431a-a649-eb96f10e7845 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 10 14:06:59.665503 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:07:00.070516 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-fc358bdb-6fb9-4770-9408-cddbafe75e79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "1", "rxtx_factor": 1.0}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:00.090210 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-fc358bdb-6fb9-4770-9408-cddbafe75e79 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.417314 Sep 10 14:07:00.090848 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:06:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:00.102974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-2ef7421b-3f1d-441a-9794-4f51ed0eb773 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:00.129831 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-2ef7421b-3f1d-441a-9794-4f51ed0eb773 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030697 Sep 10 14:07:00.130411 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 10 14:07:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:07:02.741960 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-fc358bdb-6fb9-4770-9408-cddbafe75e79 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:02.742903 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-fc358bdb-6fb9-4770-9408-cddbafe75e79 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 10 14:07:02.743308 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:03.107774 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-5c564c58-b845-4df3-a397-745d25e7f7ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2"}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:03.128216 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-5c564c58-b845-4df3-a397-745d25e7f7ea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.378153 Sep 10 14:07:03.128957 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:07:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 14:07:03.140803 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-0375c74f-9d54-4822-9f26-ffbbfaa1eac5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:03.171482 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-0375c74f-9d54-4822-9f26-ffbbfaa1eac5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034318 Sep 10 14:07:03.172259 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 10 14:07:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:07:05.870370 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-5c564c58-b845-4df3-a397-745d25e7f7ea admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:05.877295 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-5c564c58-b845-4df3-a397-745d25e7f7ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002657 Sep 10 14:07:05.877295 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:06.333971 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-2cb6b7a7-b022-49b1-8cb9-e0b7573dc151 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:06.361281 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-2cb6b7a7-b022-49b1-8cb9-e0b7573dc151 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479664 Sep 10 14:07:06.361960 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:07:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:06.374137 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-0e098f7a-c343-41d8-acd2-56c8c62c77fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:06.384055 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:07:06.403841 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-0e098f7a-c343-41d8-acd2-56c8c62c77fd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033248 Sep 10 14:07:06.404661 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 10 14:07:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:07:09.083171 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-2cb6b7a7-b022-49b1-8cb9-e0b7573dc151 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:09.084269 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-2cb6b7a7-b022-49b1-8cb9-e0b7573dc151 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 10 14:07:09.084670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:09.526752 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-dbd20864-182f-4fe2-988a-91031d7ffcf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "m1.large", "id": "4", "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:09.546478 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-dbd20864-182f-4fe2-988a-91031d7ffcf7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455515 Sep 10 14:07:09.547024 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:07:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:09.560173 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-22d8fb3c-33e8-4365-aab1-a6ee3bb6151e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:09.584381 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-22d8fb3c-33e8-4365-aab1-a6ee3bb6151e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028667 Sep 10 14:07:09.585327 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 10 14:07:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:07:12.224584 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-dbd20864-182f-4fe2-988a-91031d7ffcf7 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:12.225921 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-dbd20864-182f-4fe2-988a-91031d7ffcf7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Sep 10 14:07:12.226583 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:12.673118 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-207d672b-41dd-4a98-a7e2-bd7af90e7e07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "ram": 16384, "swap": 0}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:12.679477 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:07:12.696100 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-207d672b-41dd-4a98-a7e2-bd7af90e7e07 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462908 Sep 10 14:07:12.696983 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 10 14:07:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:12.709888 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-77c1fd45-0247-405d-85be-4e6bd80c7f96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:12.738482 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-77c1fd45-0247-405d-85be-4e6bd80c7f96 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032314 Sep 10 14:07:12.739426 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 10 14:07:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:07:29.329803 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-207d672b-41dd-4a98-a7e2-bd7af90e7e07 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:29.330818 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-207d672b-41dd-4a98-a7e2-bd7af90e7e07 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 10 14:07:29.331223 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:29.342254 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_api:SELECT=12,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:07:29.729465 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-0e9c847a-de6e-40d9-9075-5659cbeb5951 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:29.747196 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-0e9c847a-de6e-40d9-9075-5659cbeb5951 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410005 Sep 10 14:07:29.747775 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 10 14:07:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:07:31.071511 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-207d672b-41dd-4a98-a7e2-bd7af90e7e07 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:31.072515 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-207d672b-41dd-4a98-a7e2-bd7af90e7e07 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 10 14:07:31.072912 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:31.593600 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-3953e519-169b-4d3f-b9b2-f619f93388ba admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:31.598870 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.wsgi [None req-3953e519-169b-4d3f-b9b2-f619f93388ba admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-3953e519-169b-4d3f-b9b2-f619f93388ba admin admin] Request method failure captured: Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Accept: application/json Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Accept-Encoding: gzip, deflate Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Connection: keep-alive Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Content-Length: 0 Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Host: 10.222.0.26 Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Openstack-Api-Version: compute 2.92 Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Openstack-System-Scope: None Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: User-Agent: python-novaclient Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Auth-Token: gAAAAABjHJoiHaqrMUc52K8sCjzkouBSFDWqTW5Izy1VtHmZ9WpdcMQx76NAre9BukzgYEXPdGnswsf4mTlXYFcZzPm6K7vWCIRx6dfTOmi_eqnhNI4WUflwfgheAbxpchcDQwnZVyuGmhUTJwknJWeWrFrldzlz93ICCAt5FWSRiXyzt53GwHU Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Domain-Id: None Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Domain-Name: None Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Identity-Status: Confirmed Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Is-Admin-Project: True Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Domain-Id: default Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Domain-Name: Default Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Name: admin Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Role: reader,member,admin Sep 10 14:07:31.602420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Roles: reader,member,admin Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a00398c85824c23b37ffe5fee90b840", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}] Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant: admin Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant-Name: admin Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User: admin Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Domain-Id: default Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Domain-Name: Default Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Id: 25a17c1158c94c229e16c77c070bd9d7 Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Name: admin Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: method: > Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: exception: Flavor 42 could not be found. Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: action_args: {'id': '42'} Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:07:31.604161 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:31.605365 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.607135 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-3953e519-169b-4d3f-b9b2-f619f93388ba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:07:31.608558 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-3953e519-169b-4d3f-b9b2-f619f93388ba admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392509 Sep 10 14:07:31.608558 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 10 14:07:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 14:07:31.613630 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4647f08a-cdb3-46cb-8a3c-3a9698ac7516 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:31.637330 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-4647f08a-cdb3-46cb-8a3c-3a9698ac7516 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027047 Sep 10 14:07:31.637866 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 10 14:07:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:07:31.648585 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-801a392c-dd06-442d-8126-9133c80843d8 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:31.670099 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-801a392c-dd06-442d-8126-9133c80843d8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025987 Sep 10 14:07:31.670626 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 10 14:07:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:07:31.679956 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-d14df817-6247-4686-b26f-99c0b9730a18 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:31.685870 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.wsgi [None req-d14df817-6247-4686-b26f-99c0b9730a18 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-d14df817-6247-4686-b26f-99c0b9730a18 admin admin] Request method failure captured: Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Accept: application/json Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Accept-Encoding: gzip, deflate Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Connection: keep-alive Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Content-Length: 0 Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Host: 10.222.0.26 Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Openstack-Api-Version: compute 2.92 Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Openstack-System-Scope: None Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: User-Agent: python-novaclient Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Auth-Token: gAAAAABjHJoiHaqrMUc52K8sCjzkouBSFDWqTW5Izy1VtHmZ9WpdcMQx76NAre9BukzgYEXPdGnswsf4mTlXYFcZzPm6K7vWCIRx6dfTOmi_eqnhNI4WUflwfgheAbxpchcDQwnZVyuGmhUTJwknJWeWrFrldzlz93ICCAt5FWSRiXyzt53GwHU Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Domain-Id: None Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Domain-Name: None Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Identity-Status: Confirmed Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Is-Admin-Project: True Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Domain-Id: default Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Domain-Name: Default Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Name: admin Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Role: reader,member,admin Sep 10 14:07:31.689096 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Roles: reader,member,admin Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a00398c85824c23b37ffe5fee90b840", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}] Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant: admin Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant-Name: admin Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User: admin Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Domain-Id: default Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Domain-Name: Default Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Id: 25a17c1158c94c229e16c77c070bd9d7 Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Name: admin Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: method: > Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: exception: Flavor 42 could not be found. Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: action_args: {'id': '42'} Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:07:31.690670 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:31.691689 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:31.692896 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-d14df817-6247-4686-b26f-99c0b9730a18 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105575) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:07:31.694100 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-d14df817-6247-4686-b26f-99c0b9730a18 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014002 Sep 10 14:07:31.694100 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 10 14:07:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 14:07:32.915934 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-801a392c-dd06-442d-8126-9133c80843d8 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:32.916937 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-801a392c-dd06-442d-8126-9133c80843d8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 10 14:07:32.918101 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:33.443573 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4f0f0ad0-7a25-4413-b4b2-90be97299753 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:33.449202 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.wsgi [None req-4f0f0ad0-7a25-4413-b4b2-90be97299753 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4f0f0ad0-7a25-4413-b4b2-90be97299753 admin admin] Request method failure captured: Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Accept: application/json Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Accept-Encoding: gzip, deflate Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Connection: keep-alive Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Content-Length: 0 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Host: 10.222.0.26 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Openstack-Api-Version: compute 2.92 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Openstack-System-Scope: None Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: User-Agent: python-novaclient Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Auth-Token: gAAAAABjHJokL0zdGg98rNXSDEUIU4IjhReowGmkKw0mjYNAfRUq3571R02lMdPAvenwpxso03rZm5LSL1OtCXwQxAAEi5jRH0xtaqe4dzfO5jptHnsqaZCJwgWlG6G664GnGNH3NzZDsfikgug_CP8ea5uyF0F7EE63719b6LI2FcIoMkrg-_4 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Domain-Id: None Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Domain-Name: None Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Identity-Status: Confirmed Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Is-Admin-Project: True Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Domain-Id: default Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Domain-Name: Default Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Name: admin Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Role: reader,member,admin Sep 10 14:07:33.450698 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Roles: reader,member,admin Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a00398c85824c23b37ffe5fee90b840", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}] Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant: admin Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant-Name: admin Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User: admin Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Domain-Id: default Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Domain-Name: Default Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Id: 25a17c1158c94c229e16c77c070bd9d7 Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Name: admin Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: method: > Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: exception: Flavor 84 could not be found. Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: action_args: {'id': '84'} Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:07:33.452077 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:33.452852 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.453936 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4f0f0ad0-7a25-4413-b4b2-90be97299753 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105575) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:07:33.455113 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-4f0f0ad0-7a25-4413-b4b2-90be97299753 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396673 Sep 10 14:07:33.455113 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 10 14:07:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 14:07:33.461767 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-04fbd6d2-1728-4694-a416-de3079991309 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:33.477263 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-04fbd6d2-1728-4694-a416-de3079991309 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019060 Sep 10 14:07:33.477780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 10 14:07:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:07:33.487214 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-375bca50-5471-4a8d-b1fc-84451844eb2f admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:33.502482 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-375bca50-5471-4a8d-b1fc-84451844eb2f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018788 Sep 10 14:07:33.502991 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 10 14:07:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:07:33.512646 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-aa303440-e513-4bd6-89bd-8805603b25ee admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:33.517573 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.wsgi [None req-aa303440-e513-4bd6-89bd-8805603b25ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-aa303440-e513-4bd6-89bd-8805603b25ee admin admin] Request method failure captured: Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Accept: application/json Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Accept-Encoding: gzip, deflate Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Connection: keep-alive Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Content-Length: 0 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Host: 10.222.0.26 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Openstack-Api-Version: compute 2.92 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Openstack-System-Scope: None Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: User-Agent: python-novaclient Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Auth-Token: gAAAAABjHJokL0zdGg98rNXSDEUIU4IjhReowGmkKw0mjYNAfRUq3571R02lMdPAvenwpxso03rZm5LSL1OtCXwQxAAEi5jRH0xtaqe4dzfO5jptHnsqaZCJwgWlG6G664GnGNH3NzZDsfikgug_CP8ea5uyF0F7EE63719b6LI2FcIoMkrg-_4 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Domain-Id: None Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Domain-Name: None Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Identity-Status: Confirmed Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Is-Admin-Project: True Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Domain-Id: default Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Domain-Name: Default Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Name: admin Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Role: reader,member,admin Sep 10 14:07:33.519068 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Roles: reader,member,admin Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a00398c85824c23b37ffe5fee90b840", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}] Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant: admin Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant-Name: admin Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User: admin Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Domain-Id: default Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Domain-Name: Default Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Id: 25a17c1158c94c229e16c77c070bd9d7 Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Name: admin Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: method: > Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: exception: Flavor 84 could not be found. Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: action_args: {'id': '84'} Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:07:33.520683 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:33.521786 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:33.523191 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-aa303440-e513-4bd6-89bd-8805603b25ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:07:33.524447 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-aa303440-e513-4bd6-89bd-8805603b25ee admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011983 Sep 10 14:07:33.524447 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 10 14:07:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 14:07:34.810161 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-375bca50-5471-4a8d-b1fc-84451844eb2f admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:34.811307 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-375bca50-5471-4a8d-b1fc-84451844eb2f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 10 14:07:34.811762 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:35.384102 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-01628c36-fd34-4466-ac49-1f908bf7cba5 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:35.389955 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.wsgi [None req-01628c36-fd34-4466-ac49-1f908bf7cba5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-01628c36-fd34-4466-ac49-1f908bf7cba5 admin admin] Request method failure captured: Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Accept: application/json Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Accept-Encoding: gzip, deflate Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Connection: keep-alive Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Content-Length: 0 Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Host: 10.222.0.26 Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Openstack-Api-Version: compute 2.92 Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Openstack-System-Scope: None Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: User-Agent: python-novaclient Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Auth-Token: gAAAAABjHJomlVYeEfQ8xxjRZ93ojjVssd9U1o3oDAXvvjYWDzxKazF-D0LvK0IL3Bpt5p9mAxVwdLynMjc25gj2kXP5gfLNk-Z2WtTNdq4ZHsEfyobj94V6ASUnOG6f1y4t1Oa4WcnqQhIEx38hZU2bCFqG17PY-_VLhyQIHrvIs75Wcs3s8Ao Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Domain-Id: None Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Domain-Name: None Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Identity-Status: Confirmed Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Is-Admin-Project: True Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Domain-Id: default Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Domain-Name: Default Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Project-Name: admin Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Role: reader,member,admin Sep 10 14:07:35.391476 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Roles: reader,member,admin Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a00398c85824c23b37ffe5fee90b840", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}] Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant: admin Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-Tenant-Name: admin Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User: admin Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Domain-Id: default Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Domain-Name: Default Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Id: 25a17c1158c94c229e16c77c070bd9d7 Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: X-User-Name: admin Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: method: > Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: exception: Flavor 451 could not be found. Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: action_args: {'id': '451'} Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:07:35.392974 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:35.393780 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.394828 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-01628c36-fd34-4466-ac49-1f908bf7cba5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:07:35.395953 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-01628c36-fd34-4466-ac49-1f908bf7cba5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.422424 Sep 10 14:07:35.395953 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 10 14:07:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 14:07:35.403111 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-4f2a0542-ce5e-4eb7-a7a3-bf6f7694b83a admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:35.418399 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-4f2a0542-ce5e-4eb7-a7a3-bf6f7694b83a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019369 Sep 10 14:07:35.418927 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 10 14:07:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:07:35.428493 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:35.443376 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018364 Sep 10 14:07:35.443953 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 10 14:07:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:07:35.453682 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-48c3df91-7eaf-453a-82d9-287ab03e3735 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:35.458676 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.wsgi [None req-48c3df91-7eaf-453a-82d9-287ab03e3735 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-48c3df91-7eaf-453a-82d9-287ab03e3735 admin admin] Request method failure captured: Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Accept: application/json Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Accept-Encoding: gzip, deflate Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Connection: keep-alive Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Content-Length: 0 Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Host: 10.222.0.26 Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Openstack-Api-Version: compute 2.92 Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Openstack-System-Scope: None Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: User-Agent: python-novaclient Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Auth-Token: gAAAAABjHJomlVYeEfQ8xxjRZ93ojjVssd9U1o3oDAXvvjYWDzxKazF-D0LvK0IL3Bpt5p9mAxVwdLynMjc25gj2kXP5gfLNk-Z2WtTNdq4ZHsEfyobj94V6ASUnOG6f1y4t1Oa4WcnqQhIEx38hZU2bCFqG17PY-_VLhyQIHrvIs75Wcs3s8Ao Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Domain-Id: None Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Domain-Name: None Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Identity-Status: Confirmed Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Is-Admin-Project: True Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Domain-Id: default Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Domain-Name: Default Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Project-Name: admin Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Role: reader,member,admin Sep 10 14:07:35.460213 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Roles: reader,member,admin Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a00398c85824c23b37ffe5fee90b840", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a00398c85824c23b37ffe5fee90b840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a00398c85824c23b37ffe5fee90b840"}]}] Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant: admin Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant-Id: 7a00398c85824c23b37ffe5fee90b840 Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-Tenant-Name: admin Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User: admin Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Domain-Id: default Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Domain-Name: Default Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Id: 25a17c1158c94c229e16c77c070bd9d7 Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: X-User-Name: admin Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: method: > Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: exception: Flavor 451 could not be found. Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: action_args: {'id': '451'} Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:07:35.461701 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:35.462584 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: ERROR nova.api.openstack.wsgi Sep 10 14:07:35.463730 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-48c3df91-7eaf-453a-82d9-287ab03e3735 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105575) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:07:35.465268 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-48c3df91-7eaf-453a-82d9-287ab03e3735 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011707 Sep 10 14:07:35.465268 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 10 14:07:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 14:07:36.703573 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:36.704603 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 10 14:07:36.704992 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:37.232990 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-71d03984-0e69-41ec-b1a2-428225c248ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:37.251777 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-71d03984-0e69-41ec-b1a2-428225c248ad admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406040 Sep 10 14:07:37.252316 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 10 14:07:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:38.477418 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:38.478414 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 10 14:07:38.478806 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:39.002793 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-7bcdc11c-4735-4a3a-8bce-c7e881f09b4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:39.021286 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-7bcdc11c-4735-4a3a-8bce-c7e881f09b4b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403067 Sep 10 14:07:39.021876 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 10 14:07:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:40.244271 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:40.245309 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 10 14:07:40.245696 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:40.768494 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-b85d33cc-c4b3-4a39-a0ab-a050fff23d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:40.787570 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-b85d33cc-c4b3-4a39-a0ab-a050fff23d56 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403045 Sep 10 14:07:40.788114 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 10 14:07:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:42.021585 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:42.022598 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 10 14:07:42.022992 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:42.541006 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-cf351f28-ce66-449f-bddd-b31cb0dbfff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:07:42.560368 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-cf351f28-ce66-449f-bddd-b31cb0dbfff1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400310 Sep 10 14:07:42.560919 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 10 14:07:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:07:43.785228 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:43.786236 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 10 14:07:43.786642 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:07:44.313699 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-1b8bbfa5-ea62-41ed-a8a1-19fcaffcda59 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:07:44.334074 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-1b8bbfa5-ea62-41ed-a8a1-19fcaffcda59 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.408346 Sep 10 14:07:44.334538 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Sep 10 14:07:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:08:41.328246 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:08:41.329252 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-d53c4904-aca4-47cd-ab98-21f13edb1abe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 10 14:08:41.329650 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 10 14:08:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:08:41.340743 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:08:41.716807 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-61c8bd6f-c15e-4662-a83d-bf6407bc0269 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:08:41.737715 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-61c8bd6f-c15e-4662-a83d-bf6407bc0269 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402033 Sep 10 14:08:41.738248 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 10 14:08:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:08:41.759462 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_api:SELECT=14 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:08:41.763426 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-7bf589df-2f81-477e-9312-e986d5bd3a58 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:08:41.770785 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-7bf589df-2f81-477e-9312-e986d5bd3a58 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012796 Sep 10 14:08:41.771308 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Sep 10 14:08:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:08:41.782833 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-8f216f78-9484-4fee-849f-c8564ec94acd admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:08:41.789957 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-8f216f78-9484-4fee-849f-c8564ec94acd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010682 Sep 10 14:08:41.791012 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Sep 10 14:08:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:08:41.802081 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:08:41.810297 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011521 Sep 10 14:08:41.810955 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Sep 10 14:08:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:08:41.822867 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-60ff9da9-ec77-4171-ba67-8e7718337810 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:08:41.830157 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-60ff9da9-ec77-4171-ba67-8e7718337810 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011399 Sep 10 14:08:41.830709 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Sep 10 14:08:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:11:34.120320 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:34.121327 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 10 14:11:34.121718 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:11:34.263157 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_api:SELECT=6 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:11:34.440303 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:34.445076 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:34.445554 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:34.445986 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:34.446706 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:34.447156 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:34.447610 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:34.479769 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-6d1fdc69-add9-4cc5-b159-fa9c87d90281 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.217736 Sep 10 14:11:34.480405 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 10 14:11:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:11:35.560147 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:35.561151 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 10 14:11:35.561540 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:11:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:11:35.756595 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:35.760034 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:35.760505 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:35.760931 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:35.761688 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:35.762126 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:35.762532 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:35.783727 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-991eec3d-f45a-4b5f-9789-1c1af5a785e7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080307 Sep 10 14:11:35.784485 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 10 14:11:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:11:47.295350 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:47.296420 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002269 Sep 10 14:11:47.296810 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:11:47.439262 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_cell0:SELECT=4 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:11:47.439685 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_cell1:SELECT=4 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:11:47.440286 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG dbcounter [-] [105575] Writing DB stats nova_api:SELECT=8 {{(pid=105575) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:11:47.489348 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:47.492758 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:47.493236 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:47.493665 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:47.494379 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:47.494828 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:47.495247 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:47.520254 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-3bcf8864-7c8a-4702-8133-d96132f1b293 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086190 Sep 10 14:11:47.520732 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 10 14:11:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:11:48.599473 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG nova.api.openstack.wsgi [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] Calling method '>' {{(pid=105574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:48.600557 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: INFO nova.api.openstack.requestlog [None req-9c57c660-f42a-4d1c-8011-767262eedaa9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 10 14:11:48.600991 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: [pid: 105574|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 10 14:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:11:48.795065 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG nova.api.openstack.wsgi [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Calling method '>' {{(pid=105575) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:11:48.798472 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:48.798944 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:48.799369 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:48.800102 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:11:48.800549 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:11:48.800963 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: DEBUG oslo_concurrency.lockutils [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105575) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:11:48.822471 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: INFO nova.api.openstack.requestlog [None req-db49ca7f-0296-4bfc-8170-7f066950a576 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079640 Sep 10 14:11:48.823014 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: [pid: 105575|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 10 14:11:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:12:46.209414 dv-cinder-856901-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 10 14:12:46.210036 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: Sat Sep 10 14:12:46 2022 - graceful shutdown triggered... Sep 10 14:12:46.210477 dv-cinder-856901-1-iscsi devstack@n-api.service[105575]: Gracefully killing worker 2 (pid: 105575)... Sep 10 14:12:46.210842 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: Gracefully killing worker 1 (pid: 105574)... Sep 10 14:12:46.349464 dv-cinder-856901-1-iscsi devstack@n-api.service[105574]: DEBUG dbcounter [-] [105574] Writing DB stats nova_api:SELECT=4 {{(pid=105574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:12:47.210915 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: worker 1 buried after 1 seconds Sep 10 14:12:47.211494 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: worker 2 buried after 1 seconds Sep 10 14:12:47.211494 dv-cinder-856901-1-iscsi devstack@n-api.service[105573]: goodbye to uWSGI. Sep 10 14:12:47.212477 dv-cinder-856901-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 10 14:12:47.213029 dv-cinder-856901-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 10 14:12:47.215860 dv-cinder-856901-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 14:12:47.227234 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 14:12:47 2022] *** Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: nodename: dv-cinder-856901-1-iscsi Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: machine: x86_64 Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: clock source: unix Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: pcre jit disabled Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: detected number of CPU cores: 4 Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: current working directory: / Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: detected binary path: /usr/bin/uwsgi-core Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: your processes number limit is 47680 Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: your memory page size is 4096 bytes Sep 10 14:12:47.229149 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: detected max file descriptor number: 2048 Sep 10 14:12:47.230315 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: lock engine: pthread robust mutexes Sep 10 14:12:47.230315 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: thunder lock: enabled Sep 10 14:12:47.230315 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 14:12:47.230315 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 14:12:47.270690 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: Python main interpreter initialized at 0x56497c7699c0 Sep 10 14:12:47.270690 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: python threads support enabled Sep 10 14:12:47.270690 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: your server socket listen backlog is limited to 100 connections Sep 10 14:12:47.270690 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: your mercy for graceful operations on workers is 90 seconds Sep 10 14:12:47.271123 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 14:12:47.271123 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: *** Operational MODE: preforking *** Sep 10 14:12:47.271413 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: *** uWSGI is running in multiple interpreter mode *** Sep 10 14:12:47.271413 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: spawned uWSGI master process (pid: 120597) Sep 10 14:12:47.271707 dv-cinder-856901-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 10 14:12:47.272983 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: spawned uWSGI worker 1 (pid: 120616, cores: 1) Sep 10 14:12:47.273313 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: spawned uWSGI worker 2 (pid: 120617, cores: 1) Sep 10 14:12:47.273428 dv-cinder-856901-1-iscsi devstack@n-api.service[120597]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 14:12:47.943065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 14:12:47.945647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 14:12:49.116692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:12:49.116692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: from cryptography.utils import int_from_bytes Sep 10 14:12:49.117449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:12:49.117449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: from cryptography.utils import int_from_bytes Sep 10 14:12:49.117832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:12:49.117832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: from cryptography.utils import int_from_bytes Sep 10 14:12:49.118282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 14:12:49.118282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: from cryptography.utils import int_from_bytes Sep 10 14:12:51.569637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 14:12:51.570202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 14:12:51.570452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 14:12:51.570819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 14:12:51.571078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 14:12:51.571496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.571833 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.572160 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.572484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.572817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.573134 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.573461 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.573783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.574113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.574377 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.574695 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.575180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856901-1-iscsi {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.575597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.575917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.576242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.576568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.577515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.577837 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.578171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.578662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.579126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.579455 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.579800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.580117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.580437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.580778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.581209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.581529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.581864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.582212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.582625 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856901-1-iscsi {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.582962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.583272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.583615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.584040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.584356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.584672 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.584998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.585324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.585637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.585980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.586309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.586632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.586956 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.587262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.587598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.587916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.588237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.588548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.588859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.589112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.589422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.589748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.590071 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.590399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.590654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.594662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 14:12:51.595064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.595529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 14:12:51.595623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.595703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 14:12:51.595781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.595867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 14:12:51.595946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 14:12:51.596110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596528 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.596945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597110 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.597938 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598174 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598460 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.598878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856901-1-iscsi {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599344 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.599977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600334 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.600943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.601174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.601451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.601569 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.601764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.601865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602072 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.602992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.603139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.603302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.603407 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.603638 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.603745 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604134 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.604864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.605221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856901-1-iscsi {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.605438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.605537 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.605747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.605853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.606077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.606182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.606403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.606496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.606717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.606818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.607026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.607126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.607338 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.607488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.607676 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.607778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.608100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.608214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.608424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.608737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.608923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.609072 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.609254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.609398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.609567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.609724 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.609878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610656 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610824 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.610977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.611147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.611284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.611472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.611616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.611783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.611883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.612107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.612201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.612417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.612508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.612728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.612963 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.613965 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.614189 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.614286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.614475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.614578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.614780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.614881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.615084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.615178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.615389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.615515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.615730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.615832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616127 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616339 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616736 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.616957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.617049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.617269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.617371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.617590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.617691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.617897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.617998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.618214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.618309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.618595 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.618695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.618845 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.618938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.619152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.619290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.619511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.619655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.619832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.619942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.620140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.620276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.620462 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.620597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.620780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.620883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.621087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.621181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.621390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.621491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.621694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.621796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.622013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.622108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.622342 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.622442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.622645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.622790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.622881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.623111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.623208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.623349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.624009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.624174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.624603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.624709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.624974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.625089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.625322 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.625417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.625676 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.625776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.625980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.626072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.626293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.626396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.626605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.626699 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.626914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.627006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.627225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.627320 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.627564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.627674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.627879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.627983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.628186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.628282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.628494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.628587 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.628803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.628917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.629110 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.629212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.629432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.629527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.629748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.629886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.630054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.630153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.630360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.630461 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.630665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.630767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.630979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.631083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.631300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.631400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.631636 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.631742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.631956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.632057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.632266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.632359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.632573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.632720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.632861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.633011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.633247 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.633404 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.633544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.633641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.633772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.633874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.634092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.634260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.634393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.634513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.634704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.634844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.635019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.635125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.635325 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.635418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.635657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.635751 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.635961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.636064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.636264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.636364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.636567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.636671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.636871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.636972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.637172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.637271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.637473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.637565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.637773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.637868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.638092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.638231 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.638411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.638560 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.638721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.638867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.639028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.639166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.639957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.640079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.640278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.640509 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 14:12:51.640610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.640857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.640959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.641203 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.641302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.641514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.641607 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.641834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.641926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.642151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.642254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.642466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.642567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.642780 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.642888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.643096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.643218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.643412 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.643593 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.643756 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.643865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.644073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.644175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.644384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.644478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.644698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.644820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.645980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.646073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.646285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.646377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.646603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.646703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.646910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647552 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647651 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.647971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.648177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.648277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.648486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.648588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.648795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.648888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.649102 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.649206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.649409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.649510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.649738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.649879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.650581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.650697 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.650792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.650956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651677 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.651927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.652987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.653196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.653296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.653509 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.653606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.653881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.653988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.654128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.654221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.654444 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.654555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.654781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.654935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.655095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.655319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.655492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.655749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.655858 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.656065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.656159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.656396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.656507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.656713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.656815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657436 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.657952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658351 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658673 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658880 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.658980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.659201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.659301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.659553 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.659649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.659864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.659969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.660178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.660268 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.660492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.660586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.660803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.660901 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.661119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.661221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.661430 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.661530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.661737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.661838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.662985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.663090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.663294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.663388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.663634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.663799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.663974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.664979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.665188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.665310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.665501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.665598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.665810 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.665902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.666116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.666216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.666428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.666519 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.666737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.666876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.667046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.667137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.667362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.667489 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.667702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.667798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668118 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668655 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.668972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.669212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.669306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.669530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.669669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.669841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.669976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.670184 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.670327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.670546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.670652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.670966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.671104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.671297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.671563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.671715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.671880 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672190 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672345 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.672992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.673134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.673302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.673448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.673612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.673834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.673945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674555 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.674963 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.675183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.675355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.675535 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.675667 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.675854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.675993 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.676178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.676313 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.676502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.676626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.676818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.676947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.677148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.677263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.677467 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.677561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.677781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.677883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.678097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.678200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.678415 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.678554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.678732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.678870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.679048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.679193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.679379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.679515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.679724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.679832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.680041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.680136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.680355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.680504 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.680753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.680943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.681078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.681352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.681443 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.681688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.681789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.682045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.682279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.682380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.682620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.682721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.682944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.683047 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.683266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.683364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.683615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.683754 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.683913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.684013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.684229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.684343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.684540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.684634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.684853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685805 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.685901 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.686627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.686728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.686949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.687214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.687314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.687579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.687690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.687892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.687993 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.688210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.688304 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.688521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.688613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.688832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.688934 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.689142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.689289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.689453 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.689556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.689766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.689859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690189 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690793 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.690994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.691094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.691306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.691411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.691641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.691743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.691950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692565 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692880 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.692982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.693229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.693388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.693481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.693572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.693785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.693879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.694096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.694207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.694422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.694529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.694728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.694821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.695051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.695153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.695372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.695502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.695704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.695836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.696933 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697338 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.697946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.698162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.698255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.698474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.698577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.698783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.698884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.699101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.699201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.699414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.699610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.699748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.699849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.700989 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.701081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.701296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.701398 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.701602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.701760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.702562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.702680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.702981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.703121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.703378 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.703495 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.703789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.703891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.704107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.704221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.704501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.704616 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.704738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.704873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705463 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.705982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.706244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.706337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.706580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.706680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.706891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.706983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.707207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.707355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.707550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.707654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.707869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.707976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.708180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.708281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.708496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.708590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.708806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.708907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.709111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.709218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.709419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.709518 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.709721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.709820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710131 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710423 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.710944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.711059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.711247 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.711340 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.711587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.711684 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.711895 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.712909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.713122 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.713223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.713427 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.713520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.713740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.713835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.714996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.715108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.715267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.715371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.715593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.715700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.715938 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.716994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.717202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.717343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.717594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.717700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.717959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.718250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.718393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.718589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.718715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.718901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.719046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.719208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.719376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.719529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.719735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.719837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720141 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720457 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.720993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.721097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.721307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.721409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.721622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.721717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.721926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722018 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.722952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.723168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.723268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.723493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.723604 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.723803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.723911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.724116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.724211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.724465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.724574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.724730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.724866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725377 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.725979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.726120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.726244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.726399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.726551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.726705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.726863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.727943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728086 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728643 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.728957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.729164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.729277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.729476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.729577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.729847 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.730200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.730425 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.730530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.730741 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.730835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731354 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.731993 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.732121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.732297 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.732392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.732605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.732699 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.733445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.733634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.733920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.734013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.734259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.734487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.734599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.734752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.734890 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.735064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.735305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.735426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.735653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.735772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.735967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.736071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.736398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.736507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.736620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.736726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.736968 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.737072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.737277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.737380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.737635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.737802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.737959 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.738120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.738271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.738420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.738573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.738729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.738874 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739340 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.739857 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.740082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.740187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.740398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.740493 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.740712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.740820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741648 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.741967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.742062 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.742280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.742382 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.742602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.742705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.742925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.743029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.743250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.743343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.743579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.743677 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.743891 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.744964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.745139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.745247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.745450 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.745561 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.745765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.745885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.746998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.747093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.747307 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.747401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.747645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.747757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.747957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.748066 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.748279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.748386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.749133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.749242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.749468 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.749780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.749891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.750106 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.750199 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.750420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.750521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.750734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.750842 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.751044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.751266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.751379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.751515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.751710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.751820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.752022 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.752119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.752348 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.752442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.752685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.752788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753122 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.753970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.754065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.754307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.754409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.754628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.754803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.754980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.755964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.756174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.756267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.756484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.756587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.756792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.756885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.757105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.757212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.757411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.757541 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.757716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.757859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758025 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.758966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.759069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.759293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.759415 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.759632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.759755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.759943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.760058 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.760254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.760349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.760562 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.760677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.760910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761552 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.761971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.762200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.762301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.762523 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.762622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.762840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.762933 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.763150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.763242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.763479 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.763578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.763792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.763900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.764117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.764444 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.764535 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.764633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.764759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.765073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.765177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.765394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.765532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.765779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.765907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.766127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.766255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.766442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.766594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.766780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.766924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.767095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.767254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.767361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.767600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.767726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.767921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768676 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.768981 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.769205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.769297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.769521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.769633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.769835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.769938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.770146 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.770243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.770453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.770556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.770757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.770859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.771083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.771192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.771394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.771540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.771745 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.771849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.772069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.772174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.772393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.772495 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.772716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.772809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773342 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.773955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.774058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.774260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.774353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.774565 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.774666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.774884 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775345 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775679 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.775978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.776156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.776251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.776473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.776580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.776799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.776908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.777127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.777219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.777449 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.777550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.777762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.777855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.778080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.778182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.778402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.778504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.778706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.778924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.779026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.779245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.779338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.779609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.779720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.779940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.780073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.780411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.780519 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.780869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.780969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.781180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.781280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.781490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.781642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.781795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.781898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.782113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.782205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.782421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.782527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.782736 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.782827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.783044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.783135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.783352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.783470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.783698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.783836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784326 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.784967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.785183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.785292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.785538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.785635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.785860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.785956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.786188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.786291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.786507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.786600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.786825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.786918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.787143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.787274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.787477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.787630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.787793 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.787886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.788101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.788201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.788420 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.788513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.788735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.788871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.789046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.789148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.789357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.789577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.789671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.789909 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790224 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790326 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.790955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.791166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.791268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.791510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.791618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.791828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.791924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.792141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.792243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.792451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.792550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.792761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.792853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.793072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.793172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.793382 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.793475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.793693 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.793787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794320 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794423 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.794955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.795111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.795272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.795949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.796352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.796481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.796673 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.796799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.796979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.797116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.797297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.797432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.797616 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.797743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.797926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.798061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.798250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.798376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.798565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.798690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.798895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.799043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.799214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.799316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.799553 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.799664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.799909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.800040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.800233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.800369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.800546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.800767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.800866 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.801107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.801237 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.801433 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.801535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.801769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.801863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.802102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.802193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.802413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.802511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.802725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.802940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.803041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.803257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.803350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.803626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.803721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.803953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.804046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.804277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.804428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.804591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.804692 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.804905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.805933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.806141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.806248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.806452 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.806559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.806753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.806846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.807064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.807166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.807373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.807522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.807707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.807862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.808023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.808130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.808330 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.808422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.808682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.808865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809643 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.809980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.810201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.810294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.810522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.810616 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.810833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.810935 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.811702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.811896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.812044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.812367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.812467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.812678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.812772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.812998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.813089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.813313 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.813444 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.813622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.813762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.813929 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.814965 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.815175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.815278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.815504 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.815636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.815839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.815931 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.816150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.816299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.816476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.816617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.816767 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.816869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.817082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.817177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.817389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.817483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.817694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.817830 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818711 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.818921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.819023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.819271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.819377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.819601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.819709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.819916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820328 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.820932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.821145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.821246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.821456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.821563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.821759 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.821859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822676 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.822981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.823082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.823286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.823393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.823621 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.823718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.823930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.824030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.824237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.824484 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.824577 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.824823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.824924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.825125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.825226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.825458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.825592 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.825789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.825891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.826097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.826250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.826405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.826501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.826799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.826910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.827063 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.827334 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.827431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.827695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.827791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828015 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828118 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828471 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828742 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.828955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.829987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.830204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.830288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.830514 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.830603 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.830991 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.831873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.832149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.832254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.832430 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.832526 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.832752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.832837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.833073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.833163 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.833525 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.833634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.833718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.833798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.834935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.835025 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.835263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.835369 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.835586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.835688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.835970 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.836076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.836256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.836429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.836585 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.836740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.836893 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.837047 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.837209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.837364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.837529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.837688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.838062 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.838235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.838400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.838554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.838715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.838911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.839162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.839321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.839639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.839973 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.840120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.840469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.840607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.840752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.840888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 14:12:51.841853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.841853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.842828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.842828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.843199 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.843603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.843905 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.844209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.844608 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.844882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.845596 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.845596 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.846033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.846033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.846574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.846744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.846966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.847355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.847627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.847949 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.848260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.849351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.849351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.849351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.849858 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.849858 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.850083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.850895 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.850895 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.851228 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.851396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.851693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.852062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.852386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.852713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.853043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.853346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.853669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.854012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.854331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.854632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.855204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.855563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.855897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.856206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.856579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.856853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.857172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.857489 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.858442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.858743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.859311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.859661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.859977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.860291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.860603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.860922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.861234 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.861544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.861861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.862176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.862508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.862838 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.863147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.863506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.863839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.864188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.864498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.864841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.865173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.865488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.865799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.866105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 14:12:51.866349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 14:12:51.904377 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO dbcounter [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Registered counter for database nova_api Sep 10 14:12:51.925645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:51.929823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO dbcounter [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Registered counter for database nova_api Sep 10 14:12:51.932440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writer thread running {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:51.950850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_db.sqlalchemy.engines [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:51.958018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writer thread running {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:51.990410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.context [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab3df0e3-6de0-42ba-8be2-84cbff7aa19d(cell1) {{(pid=120617) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 14:12:51.994466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:12:51.994944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:12:51.996543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:12:51.997284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:12:51.997732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:12:52.000661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:12:52.002648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO dbcounter [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Registered counter for database nova_cell0 Sep 10 14:12:52.006667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO dbcounter [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Registered counter for database nova_cell1 Sep 10 14:12:52.014104 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:52.017191 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:52.017927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.context [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab3df0e3-6de0-42ba-8be2-84cbff7aa19d(cell1) {{(pid=120616) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 14:12:52.021242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writer thread running {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:52.022377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:12:52.022914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:12:52.024679 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:12:52.025432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:12:52.025888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:12:52.027468 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writer thread running {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:52.028209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:12:52.030634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO dbcounter [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Registered counter for database nova_cell0 Sep 10 14:12:52.034708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO dbcounter [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Registered counter for database nova_cell1 Sep 10 14:12:52.042176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_db.sqlalchemy.engines [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:52.043977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_db.sqlalchemy.engines [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:52.051520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writer thread running {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:52.051869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writer thread running {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:52.177601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO dbcounter [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Registered counter for database nova_cell0 Sep 10 14:12:52.184703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:52.189910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writer thread running {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:52.201563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO dbcounter [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Registered counter for database nova_cell0 Sep 10 14:12:52.208939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_db.sqlalchemy.engines [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 14:12:52.213581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writer thread running {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 14:12:52.518784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: WARNING keystonemiddleware.auth_token [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:12:52.526003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: WARNING keystonemiddleware.auth_token [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:12:52.539782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: WARNING keystonemiddleware.auth_token [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:12:52.547192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: WARNING keystonemiddleware.auth_token [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:12:52.879311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: WARNING keystonemiddleware.auth_token [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:12:52.885620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: WARNING keystonemiddleware.auth_token [None req-c2a0e496-2fd0-44ac-bd70-06285ad9bcd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:12:52.892050 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56497c7699c0 pid: 120617 (default app) Sep 10 14:12:52.900325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: WARNING keystonemiddleware.auth_token [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 14:12:52.906831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: WARNING keystonemiddleware.auth_token [None req-9847a2c2-be84-433e-9d23-b57b67bba525 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 14:12:52.912122 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56497c7699c0 pid: 120616 (default app) Sep 10 14:13:28.754449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:28.755993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:28.759137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:28.760163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6e508dfa-ceb9-492e-818e-307ce7cc8da6 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Action: 'create', calling method: .version_select at 0x7ff6b81163a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1841848915", "metadata": {"Type": "work"}}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6e508dfa-ceb9-492e-818e-307ce7cc8da6 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Request method failure captured: Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 122 Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuIY3L0kkHAPRROVhZk18tWBJL6Sdj3YJUQR9UHaIrUxxZGHyDMDxa9q1IipYJqcwA4aAmbgkpMOzOkqgXmUAjSUQ0_X-x0eEP7FB_OtyJVWEyNBtiqh1mTUuA_zsh9A0xxeNdna6dyzBaQ1TFQYlI0zFFrUsH2GEObR6U4ksrnoTg Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:13:30.164232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_518d6393ac634ebdaf81fa58432e0422", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}] Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 4750e4e76e46440b887c7d878812916d Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1841848915", "metadata": {"Type": "work"}}} Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: Sep 10 14:13:30.178928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1841848915', 'metadata': {'Type': 'work'}}}} Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise error Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi '#$%' Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:13:30.180091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 14:13:30.181652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 14:13:30.184922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 14:13:30.184922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.184922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6e508dfa-ceb9-492e-818e-307ce7cc8da6 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:13:30.184922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6e508dfa-ceb9-492e-818e-307ce7cc8da6 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.413046 Sep 10 14:13:30.184922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 10 14:13:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1415 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:13:30.468978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-087d54f4-a36a-4e0d-a4ae-c73390a80218 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Action: 'create', calling method: .version_select at 0x7ff6b81c64c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1279424445", "metadata": {"Type": "work"}}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-087d54f4-a36a-4e0d-a4ae-c73390a80218 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Request method failure captured: Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 120 Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuIY3L0kkHAPRROVhZk18tWBJL6Sdj3YJUQR9UHaIrUxxZGHyDMDxa9q1IipYJqcwA4aAmbgkpMOzOkqgXmUAjSUQ0_X-x0eEP7FB_OtyJVWEyNBtiqh1mTUuA_zsh9A0xxeNdna6dyzBaQ1TFQYlI0zFFrUsH2GEObR6U4ksrnoTg Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:13:30.475510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_518d6393ac634ebdaf81fa58432e0422", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}] Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 4750e4e76e46440b887c7d878812916d Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1279424445", "metadata": {"Type": "work"}}} Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: Sep 10 14:13:30.476788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1279424445', 'metadata': {'Type': 'work'}}}} Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise error Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi '0' Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:13:30.477550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 14:13:30.478915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 14:13:30.481340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 14:13:30.481340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.481340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-087d54f4-a36a-4e0d-a4ae-c73390a80218 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:13:30.481340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-087d54f4-a36a-4e0d-a4ae-c73390a80218 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.315444 Sep 10 14:13:30.481340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 10 14:13:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:13:30.501325 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2056900a-3b73-4f48-b745-5b8e9a7b04ff tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Action: 'create', calling method: .version_select at 0x7ff6b8116ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2132033631", "metadata": {"Type": "work"}}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2056900a-3b73-4f48-b745-5b8e9a7b04ff tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Request method failure captured: Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 119 Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuIY3L0kkHAPRROVhZk18tWBJL6Sdj3YJUQR9UHaIrUxxZGHyDMDxa9q1IipYJqcwA4aAmbgkpMOzOkqgXmUAjSUQ0_X-x0eEP7FB_OtyJVWEyNBtiqh1mTUuA_zsh9A0xxeNdna6dyzBaQ1TFQYlI0zFFrUsH2GEObR6U4ksrnoTg Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:13:30.516851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_518d6393ac634ebdaf81fa58432e0422", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}] Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 4750e4e76e46440b887c7d878812916d Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2132033631", "metadata": {"Type": "work"}}} Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: Sep 10 14:13:30.518074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2132033631', 'metadata': {'Type': 'work'}}}} Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise error Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi '' Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:13:30.519249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 14:13:30.521969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 14:13:30.524477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 14:13:30.524477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:30.524477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2056900a-3b73-4f48-b745-5b8e9a7b04ff tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:13:30.524477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2056900a-3b73-4f48-b745-5b8e9a7b04ff tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031418 Sep 10 14:13:30.525362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:30.525362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:30.526018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:30.526674 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:13:30.534177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 10 14:13:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:13:30.535299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f626e4f1-d24d-45cf-a8b9-c66d4bb9c5d0 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Calling method '.version_select at 0x7ff6b81359d0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:31.167387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-f626e4f1-d24d-45cf-a8b9-c66d4bb9c5d0 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] HTTP exception thrown: Volume tempest-invalid-2118342160 could not be found. Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f626e4f1-d24d-45cf-a8b9-c66d4bb9c5d0 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Request method failure captured: Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2118342160 HTTP/1.1 Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuIY3L0kkHAPRROVhZk18tWBJL6Sdj3YJUQR9UHaIrUxxZGHyDMDxa9q1IipYJqcwA4aAmbgkpMOzOkqgXmUAjSUQ0_X-x0eEP7FB_OtyJVWEyNBtiqh1mTUuA_zsh9A0xxeNdna6dyzBaQ1TFQYlI0zFFrUsH2GEObR6U4ksrnoTg Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:13:31.172094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_518d6393ac634ebdaf81fa58432e0422", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}] Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 4750e4e76e46440b887c7d878812916d Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Volume tempest-invalid-2118342160 could not be found. Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'tempest-invalid-2118342160'} Sep 10 14:13:31.173669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2118342160 could not be found. (HTTP 404) (Request-ID: req-a86f9bc6-a46b-418f-a391-db7d697fd550) Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.174588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 14:13:31.175870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2118342160 could not be found. Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:13:31.178748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2118342160 could not be found. Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2118342160 could not be found. Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f626e4f1-d24d-45cf-a8b9-c66d4bb9c5d0 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Returning 404 to user: Volume tempest-invalid-2118342160 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:13:31.180200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f626e4f1-d24d-45cf-a8b9-c66d4bb9c5d0 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2118342160" status: 404 len: 99 microversion: 2.1 time: 0.655867 Sep 10 14:13:31.181825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 10 14:13:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2118342160 => generated 99 bytes in 660 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 14:13:31.196537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-683c14c9-229f-4e6a-b960-6896a8d63824 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008567 Sep 10 14:13:31.201680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 10 14:13:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 14:13:31.211090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7938e940-d28d-4e5e-9426-a3d0dc720926 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007839 Sep 10 14:13:31.222285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a5305064-9ab2-4e62-bb70-c9c1ce094cc9 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Calling method '.version_select at 0x7ff6b7fd9310>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:31.227562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 10 14:13:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 14:13:31.572543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-a5305064-9ab2-4e62-bb70-c9c1ce094cc9 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] HTTP exception thrown: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a5305064-9ab2-4e62-bb70-c9c1ce094cc9 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Request method failure captured: Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: DELETE /compute/v2.1/os-volumes/9b225d9c-283c-4290-8895-a7a20e95d190 HTTP/1.1 Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuIY3L0kkHAPRROVhZk18tWBJL6Sdj3YJUQR9UHaIrUxxZGHyDMDxa9q1IipYJqcwA4aAmbgkpMOzOkqgXmUAjSUQ0_X-x0eEP7FB_OtyJVWEyNBtiqh1mTUuA_zsh9A0xxeNdna6dyzBaQ1TFQYlI0zFFrUsH2GEObR6U4ksrnoTg Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:13:31.577816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_518d6393ac634ebdaf81fa58432e0422", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}] Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 4750e4e76e46440b887c7d878812916d Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '9b225d9c-283c-4290-8895-a7a20e95d190'} Sep 10 14:13:31.579359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. (HTTP 404) (Request-ID: req-2d8b274c-5479-4010-ba27-6d2fb0573715) Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.580366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 14:13:31.581685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 14:13:31.584557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a5305064-9ab2-4e62-bb70-c9c1ce094cc9 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Returning 404 to user: Volume 9b225d9c-283c-4290-8895-a7a20e95d190 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:13:31.586478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a5305064-9ab2-4e62-bb70-c9c1ce094cc9 tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/9b225d9c-283c-4290-8895-a7a20e95d190" status: 404 len: 109 microversion: 2.1 time: 0.361684 Sep 10 14:13:31.590615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a64dbc94-914e-4e14-93d6-505dbb2c84dc tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Calling method '.version_select at 0x7ff6b7f55f70>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:31.597231 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:13:31 2022] DELETE /compute/v2.1/os-volumes/9b225d9c-283c-4290-8895-a7a20e95d190 => generated 109 bytes in 380 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:13:31.644602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-a64dbc94-914e-4e14-93d6-505dbb2c84dc tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] HTTP exception thrown: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a64dbc94-914e-4e14-93d6-505dbb2c84dc tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Request method failure captured: Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/os-volumes/c29c6adf-95af-4178-8933-51ee4cfb6144 HTTP/1.1 Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuIY3L0kkHAPRROVhZk18tWBJL6Sdj3YJUQR9UHaIrUxxZGHyDMDxa9q1IipYJqcwA4aAmbgkpMOzOkqgXmUAjSUQ0_X-x0eEP7FB_OtyJVWEyNBtiqh1mTUuA_zsh9A0xxeNdna6dyzBaQ1TFQYlI0zFFrUsH2GEObR6U4ksrnoTg Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:13:31.646746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_518d6393ac634ebdaf81fa58432e0422", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/518d6393ac634ebdaf81fa58432e0422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/518d6393ac634ebdaf81fa58432e0422"}]}] Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 518d6393ac634ebdaf81fa58432e0422 Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesNegativeTest-1565094912 Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 4750e4e76e46440b887c7d878812916d Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesNegativeTest-1565094912-project Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'c29c6adf-95af-4178-8933-51ee4cfb6144'} Sep 10 14:13:31.648215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. (HTTP 404) (Request-ID: req-37dd0ef0-ab07-4bee-841f-74ba2eaf8073) Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.649155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:13:31.650280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 14:13:31.651365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a64dbc94-914e-4e14-93d6-505dbb2c84dc tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] Returning 404 to user: Volume c29c6adf-95af-4178-8933-51ee4cfb6144 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:13:31.656434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a64dbc94-914e-4e14-93d6-505dbb2c84dc tempest-VolumesNegativeTest-1565094912 tempest-VolumesNegativeTest-1565094912-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c29c6adf-95af-4178-8933-51ee4cfb6144" status: 404 len: 109 microversion: 2.1 time: 0.063661 Sep 10 14:13:31.661419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:13:31 2022] GET /compute/v2.1/os-volumes/c29c6adf-95af-4178-8933-51ee4cfb6144 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:13:39.039279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1e88b888-256a-4f82-acca-7becc07db5c7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: .version_select at 0x7ff6b7f61d30>, body: {"keypair": {"name": "tempest-keypair-1462892885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHA7s32lh647qI5QVP6kAl6xqaNi0vVr/tgYhfeDFS1kZVIoqIwQFeVmaZBN7Vq6SRNGvtAU7pm3ERS3aBy28dn4SjR7W3Z0vtI8yTMSBCLCub5CJb8vVdBmJV6zGtDUQ=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:39.102640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-1e88b888-256a-4f82-acca-7becc07db5c7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:39.115598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-1e88b888-256a-4f82-acca-7becc07db5c7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:39.198660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1e88b888-256a-4f82-acca-7becc07db5c7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.719132 Sep 10 14:13:39.199225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 5/9] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:13:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:13:46.640849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1435522666", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6130204-567f-432e-9831-4386656cd324"}], "security_groups": [{"name": "tempest-securitygroup--483670420"}], "key_name": "tempest-keypair-1462892885", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:47.187569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] validate_networks() for [('c6130204-567f-432e-9831-4386656cd324', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:13:48.087156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-553c3179-0919-49ac-bf07-cabee8275912 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: .version_select at 0x7ff6b7ed8700>, body: {"keypair": {"name": "tempest-keypair-1717512150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHISuVB1jkZ8j/sm79kqUhveSz0rMKSUJhRL/j50mBlI4nsOnE4Q5G5awPqphMgzOvrbydYP8ydkWThWmo1lGvSoiwK3mVjh7KmLc5f6DWPZ6258Iajg+xDRYgsLhT8YuQ=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:48.135796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-553c3179-0919-49ac-bf07-cabee8275912 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:48.156880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-553c3179-0919-49ac-bf07-cabee8275912 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for user 8ea8ba61dfa54cbc9a45543d20f31e76 and project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:48.203557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-553c3179-0919-49ac-bf07-cabee8275912 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.933421 Sep 10 14:13:48.212137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 6/10] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:13:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:13:49.985441 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:13:49.985865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:13:49.986344 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:13:49.986806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:13:49.987221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:13:50.014395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:50.015113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:50.015800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:50.017454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:50.018738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:50.019374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:50.068793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:50.077930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:50.093279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:13:50.098354 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:13:50.366491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ba491b9f-f2b6-4259-945a-425112edb3a6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.727345 Sep 10 14:13:50.382991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b841d3f6-b426-47f9-915f-b61380504293 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:50.385657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b841d3f6-b426-47f9-915f-b61380504293 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:50.392096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 5/11] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:13:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 3758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:13:50.752197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b841d3f6-b426-47f9-915f-b61380504293 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:50.803369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b841d3f6-b426-47f9-915f-b61380504293 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1242 microversion: 2.1 time: 0.426762 Sep 10 14:13:50.811925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:50 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1242 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:50.993587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-52c83378-09d5-4e56-ab9d-7cc477f53f64 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'create', calling method: .version_select at 0x7ff6b7e79e50>, body: {"keypair": {"name": "tempest-keypair-1989421728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsDBJQeDz3DqrZVFqBBqw81E5AvqA+5WkfjrAUoQPw949I19TT49uIsGYrS5+MHWCoyvAd3Rta/bBweaMlJWfwrBqlA6JdQmI869c6aiW9keNINrCsws2585/ibkhPnmQ=="}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:51.066292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-52c83378-09d5-4e56-ab9d-7cc477f53f64 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:51.077338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-52c83378-09d5-4e56-ab9d-7cc477f53f64 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for user 810f0fa1f7774b37a09a91964c40b823 and project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:51.190202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-52c83378-09d5-4e56-ab9d-7cc477f53f64 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.792853 Sep 10 14:13:51.196243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 6/13] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 10 14:13:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 803 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 14:13:51.910762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-84589599", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "networks": [{"uuid": "4b1c480a-7841-4ad5-81e5-fa17d2e65e22"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:51.924154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1155311425", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:52.066432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] validate_networks() for [('fa8a33cb-7e36-4402-b68d-98738d77dd04', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:13:52.132035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] validate_networks() for [('4b1c480a-7841-4ad5-81e5-fa17d2e65e22', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:13:53.471765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:13:53.477860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:13:53.479255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:13:53.479706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:13:53.480128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:13:53.522077 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:53.522077 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:53.522077 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:53.524437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:53.525426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:53.545996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:53.597909 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:53.602697 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for user 8f96c9a2a49047b5b8abd3b2c1475a18 and project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:53.621743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:13:53.625114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:13:53.781629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f6b5470f-7240-4ce8-b080-b25780dd144e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.584249 Sep 10 14:13:53.789007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 7/14] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:13:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:13:53.820493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:53.821226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:53.874388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:53.874888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:53.875326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:53.883644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:53.895114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:53.896162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:54.583854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:54.618776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a09ac28f-c298-408b-9865-3ced4611c2c8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1238 microversion: 2.1 time: 0.824770 Sep 10 14:13:54.619371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:53 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1238 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:54.630043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bc21dde2-c868-4423-a9d7-c29ffb71aa84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:54.631039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bc21dde2-c868-4423-a9d7-c29ffb71aa84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:55.071820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:13:55.072985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:13:55.073616 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:13:55.075438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:13:55.076189 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:13:55.108831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:55.110765 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:55.125318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bc21dde2-c868-4423-a9d7-c29ffb71aa84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:55.137631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:55.138960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:55.140141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:55.140602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:55.154645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bc21dde2-c868-4423-a9d7-c29ffb71aa84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1222 microversion: 2.1 time: 0.529515 Sep 10 14:13:55.155785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:54 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1222 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:55.292627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Getting quotas for project 06101fb7de2e4338967b29365e713677. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:55.315946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Getting quotas for user 5ca58aca3f9d4d8fa9f1c6315db7f54d and project 06101fb7de2e4338967b29365e713677. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:55.377134 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:13:55.386435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:13:55.431823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1988675785", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0530a74-5c63-47f6-82f4-eebc1378a61a"}], "security_groups": [{"name": "tempest-securitygroup--355807558"}], "key_name": "tempest-keypair-1717512150", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:55.729515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4c714f7a-c8d9-4ea2-a678-8884541b6413 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.724490 Sep 10 14:13:55.738103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 8/17] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 14:13:55.760554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1649872220", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:55.899429 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] validate_networks() for [('fa8a33cb-7e36-4402-b68d-98738d77dd04', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:13:56.004210 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] validate_networks() for [('e0530a74-5c63-47f6-82f4-eebc1378a61a', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:13:57.219642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:13:57.220279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:13:57.220546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:13:57.220965 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:13:57.221381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:13:57.230803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.232434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.233064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.234277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.234932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.235593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.256673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:57.261487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for user 8ea8ba61dfa54cbc9a45543d20f31e76 and project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:57.273868 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:13:57.276663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:13:57.284963 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:13:57.285716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:13:57.286280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:13:57.287046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:13:57.287221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:13:57.302611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.303549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.304446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.306022 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.306983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.307700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.332633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:57.337160 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for user 8f96c9a2a49047b5b8abd3b2c1475a18 and project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:57.343128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9a9b2440-a676-4914-857c-1fed264d493e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.916028 Sep 10 14:13:57.350679 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 10/18] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:13:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 14:13:57.351950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:57.353130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:57.362140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.362924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.363625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.364543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.365217 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.365540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:13:57.366087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.371160 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:13:57.513515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-491de006-794a-4375-8e30-8569a24d919b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.773329 Sep 10 14:13:57.528085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 9/19] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:13:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:13:57.534949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:57.535598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:57.540966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:57.556228 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0e14ff11-3f98-4294-a259-aabbda562c93 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1294 microversion: 2.1 time: 0.210078 Sep 10 14:13:57.557962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:57 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1294 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:57.567256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-604101136", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8da15eba-048a-487b-8b2b-8df4d906800c"}], "security_groups": [{"name": "tempest-securitygroup--1999722963"}], "key_name": "tempest-keypair-1989421728", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:13:57.601108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.605815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.606732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.608460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:57.610100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:57.610771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:57.907055 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] validate_networks() for [('8da15eba-048a-487b-8b2b-8df4d906800c', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:13:58.023344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:58.057831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fc07aa5a-fa25-469f-a441-c4a1bf58f289 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1217 microversion: 2.1 time: 0.521903 Sep 10 14:13:58.059477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:57 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1217 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:58.069040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7a039a80-5575-4046-818a-a03bf9f6bb2a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:58.073278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7a039a80-5575-4046-818a-a03bf9f6bb2a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:58.269954 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7a039a80-5575-4046-818a-a03bf9f6bb2a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:58.278360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7a039a80-5575-4046-818a-a03bf9f6bb2a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1238 microversion: 2.1 time: 0.217417 Sep 10 14:13:58.285737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:58 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1238 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:58.320120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1d40e3d6-3717-4c2b-9734-146a6bd16e99 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:58.322630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1d40e3d6-3717-4c2b-9734-146a6bd16e99 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:58.447112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1d40e3d6-3717-4c2b-9734-146a6bd16e99 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:58.459390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1d40e3d6-3717-4c2b-9734-146a6bd16e99 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1222 microversion: 2.1 time: 0.162808 Sep 10 14:13:58.461200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:58 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:58.584506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:58.585812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:58.599659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:58.603427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:58.604621 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:58.607379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:58.610311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:58.612153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:58.809942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:58.823825 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-35b71207-1b29-4974-82bb-32d6aaa27b41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1294 microversion: 2.1 time: 0.244910 Sep 10 14:13:58.836973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:58 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1294 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:58.898386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:13:58.898860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:13:58.899582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:13:58.900204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:13:58.900766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:13:58.922388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:58.923414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:58.926562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:58.930634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:58.931371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:58.931992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:58.978652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:13:58.995927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for user 810f0fa1f7774b37a09a91964c40b823 and project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:13:59.034128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:13:59.040670 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:13:59.085278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:59.086720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:59.112970 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.119806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.120479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.126775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.127582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.128588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.152752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-94dda794-bd05-4b0b-a11a-a52db7db970f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.591918 Sep 10 14:13:59.157266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 12/25] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 10 14:13:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 14:13:59.168810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-be099e93-4ce9-498f-9fff-2a9e24cb3b80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:59.172460 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-be099e93-4ce9-498f-9fff-2a9e24cb3b80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:59.301540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:59.317888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7e391f5a-7ea4-44e9-a27c-cc068eaa707f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1217 microversion: 2.1 time: 0.237215 Sep 10 14:13:59.319293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 14/26] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:59 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:59.357745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:59.361230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:59.373341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-be099e93-4ce9-498f-9fff-2a9e24cb3b80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:59.385621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-be099e93-4ce9-498f-9fff-2a9e24cb3b80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:59.389403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-be099e93-4ce9-498f-9fff-2a9e24cb3b80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:59.392647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-be099e93-4ce9-498f-9fff-2a9e24cb3b80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1281 microversion: 2.20 time: 0.227995 Sep 10 14:13:59.396370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 13/27] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:13:59 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:13:59.425751 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.426409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.427524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.433987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.436274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.437534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.486542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:59.487231 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:59.500324 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.500727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.502496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.504634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.506614 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.507506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.615318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:59.620489 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:13:59.629277 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fc7d393f-9f11-4381-82dc-d99fc12eb7df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1242 microversion: 2.1 time: 0.307744 Sep 10 14:13:59.630038 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:59 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:13:59.643643 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1e724243-2d4b-4b71-822a-ce37c591d64e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1226 microversion: 2.1 time: 0.152975 Sep 10 14:13:59.643643 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:59 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1226 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:13:59.864393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:13:59.865305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:13:59.885846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.890289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.890776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:13:59.891568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:13:59.892050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:13:59.907690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.073843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:00.084670 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9e005bbb-83e3-42bf-a6c1-885b1668256b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1294 microversion: 2.1 time: 0.234739 Sep 10 14:14:00.085774 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:13:59 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:00.345987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:00.346633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:00.362722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.363226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.375111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.376004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.376491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.376936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.447923 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:00.448893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:00.476964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:00.491619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.493196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.495052 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.500099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.503179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.505992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.566782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:00.582370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-37200fd0-b96a-4cdb-89a2-96e4656950b6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1209 microversion: 2.1 time: 0.241164 Sep 10 14:14:00.583467 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:00 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1209 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:00.658664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:00.659174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:00.674553 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.676940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.678342 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.686842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.688741 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.689551 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.828950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:00.836685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-31d9acbf-9841-45f2-8d03-1d228bf25e59 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1234 microversion: 2.1 time: 0.183142 Sep 10 14:14:00.837249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:00 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1234 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:00.860394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:00.861986 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:00.868280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.868909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.869687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.870532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:00.871218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:00.872646 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:00.958660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:00.973372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:00.974772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:00.986319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-55e741b3-a721-40ad-932e-f9500397a2af tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1285 microversion: 2.20 time: 0.558034 Sep 10 14:14:00.986945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 16/33] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:00 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1285 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:01.041705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:01.062697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2f087802-c2a0-4d2d-bcc7-848907b1722c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1218 microversion: 2.1 time: 0.213563 Sep 10 14:14:01.075254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 18/34] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:00 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:01.121274 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:01.122177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:01.139113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:01.142128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:01.142926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:01.147188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:01.148660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:01.150258 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:01.277808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:01.289156 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-004c9bc1-2c18-45a7-a383-640836031f62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1300 microversion: 2.1 time: 0.179767 Sep 10 14:14:01.290573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 17/35] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:01 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:01.613591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:01.614981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:01.621584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:01.622656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:01.624340 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:01.626411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:01.627173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:01.627855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:01.729350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:01.759084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8c33cab3-25a7-4a40-a15b-7e7ef6f79899 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1209 microversion: 2.1 time: 0.149601 Sep 10 14:14:01.760279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:01 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1209 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:01.870218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:01.870905 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:01.889305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:01.894745 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:01.896553 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:01.899429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:01.903991 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:01.905181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.014618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:02.017602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:02.033033 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.037448 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.040119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.042175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.045668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.047995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.237363 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:02.247337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:02.258031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:02.263761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2ae1672f-2d16-42ac-a41f-a5d03bd6a51e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1277 microversion: 2.20 time: 0.253418 Sep 10 14:14:02.272250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 20/37] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:02 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:14:02.292314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:02.293033 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:02.318692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.319194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.319678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.320903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.322503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.323165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.557456 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:02.567401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8d07f225-36fe-4153-8b4e-12f01c56e424 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1290 microversion: 2.1 time: 0.701746 Sep 10 14:14:02.573721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 18/38] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:01 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1290 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:02.584359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:02.585348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:02.596380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.597183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.597827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.599649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.600312 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.600971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.625900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:02.638316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-50c61750-6f21-4cc6-bab2-65401763ff8d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1218 microversion: 2.1 time: 0.364882 Sep 10 14:14:02.638911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 21/39] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:02 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1218 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:02.771490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:02.786406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:02.787661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:02.798539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.801255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.803733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.806891 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-62da70c1-0b67-4239-890a-837da6663c74 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1300 microversion: 2.1 time: 0.231814 Sep 10 14:14:02.807422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:02.808255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:02.811749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:02.828666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 19/40] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:02 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:03.027344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:03.056841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f75aa1d6-c89a-4abc-a772-cb81e891b644 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1209 microversion: 2.1 time: 0.275634 Sep 10 14:14:03.057531 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 22/41] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:02 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1209 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:03.296356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:03.296981 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:03.322862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:03.323384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:03.323854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:03.343874 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:03.352445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:03.353137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:03.594407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:03.595480 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:03.614631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:03.623988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:03.626912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:03.634707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:03.645852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:03.651017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:03.878734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:03.891477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:03.901436 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:03.912272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-36cc30ac-61af-4031-b648-c7336d81d05a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1277 microversion: 2.20 time: 0.624047 Sep 10 14:14:03.913468 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 20/42] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:03 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1277 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:03.947271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:03.967359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:03.976903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:03.978104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:03.978775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:03.980761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:03.982241 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:03.982907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:04.164916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:04.179868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ca71ac64-e8d7-4b62-af14-ee8ea1bf41f0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1296 microversion: 2.1 time: 0.583190 Sep 10 14:14:04.193900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 23/43] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:03 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1296 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:04.209276 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:04.225647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-561d6ad4-5987-4d99-a0bd-4a38731d6637 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1274 microversion: 2.1 time: 0.296179 Sep 10 14:14:04.226227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 21/44] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:03 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:04.253573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:04.254712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:04.255905 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:04.256591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:04.284525 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:04.285223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:04.285759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:04.285884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:04.286640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:04.287197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:04.287752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:04.287943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:04.288386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:04.292138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:04.292644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:04.293074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:04.617660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:04.631568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e572bfab-4b56-4ee9-8a7a-e2b9389fd2dc tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1209 microversion: 2.1 time: 0.396117 Sep 10 14:14:04.634453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 22/45] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:04 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1209 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:04.948381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:04.949223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:04.967362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:04.968326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:04.969351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:04.970299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:04.970896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:04.971683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:05.211269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:05.233635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:05.241138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:05.245812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1e0f0fa0-64cf-4fcd-a9a1-869473a79de8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1277 microversion: 2.20 time: 0.301566 Sep 10 14:14:05.268343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:04 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:05.293501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:05.295825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:05.316355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:05.332523 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:05.333050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:05.339584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:05.353593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:05.358502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:05.646370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:05.659197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ec6db79a-880b-4325-83a8-9f723a3c8a48 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 1.451275 Sep 10 14:14:05.661991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 24/47] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:04 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:05.695008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:05.695727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:05.703382 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:05.704162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:05.704766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:05.705618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:05.706219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:05.706787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:05.958549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:05.968435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ed186d8f-3ec2-4fd5-bac1-d0a750128d08 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1280 microversion: 2.1 time: 0.305336 Sep 10 14:14:05.974848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:05 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:06.003969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:06.008028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:06.022506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:06.024768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:06.025434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:06.027278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:06.030343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:06.030856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:06.031704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:06.057692 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-43e4f4cd-ee7c-426d-94e0-5eff7e728171 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1296 microversion: 2.1 time: 0.784485 Sep 10 14:14:06.061944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:05 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1296 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:06.293167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:06.294366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:06.313852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:06.323336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:06.323826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:06.324577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:06.325080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:06.325505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:06.457628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:06.479116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-dbb62006-a0a9-4786-838c-d5e6e6022636 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1265 microversion: 2.1 time: 0.483248 Sep 10 14:14:06.483082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 26/50] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:05 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1265 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:06.687827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:06.689785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:06.695812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:06.715389 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:06.720255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:06.723356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:06.727692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:06.729964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:06.734902 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:07.305116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:07.315514 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:07.320487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:07.327265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:07.328890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-90b75049-5bb6-49d1-ae89-8b449e21b48c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1277 microversion: 2.20 time: 1.047699 Sep 10 14:14:07.338120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:06 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1277 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:07.352581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:07.356507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:07.376200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:07.385239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:07.392148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:07.393293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:07.394018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:07.394686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:07.831096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:07.885056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-78770d61-bf04-4a8c-8396-96d767be0bbc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1280 microversion: 2.1 time: 0.533783 Sep 10 14:14:07.890655 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:07 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1280 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:07.910442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:07.915624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:07.940007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:07.942835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:07.943570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:07.944551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:07.947065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:07.947752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:07.967059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:08.069091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:08.073116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:08.086227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cf8f1cb9-c300-4375-9f16-8bf6b1b1b764 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 1.405953 Sep 10 14:14:08.087159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 27/53] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:06 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:08.104304 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:08.113831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-75252238-d595-440e-9484-dc224082c12b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1296 microversion: 2.1 time: 0.219820 Sep 10 14:14:08.118424 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 27/54] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:07 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1296 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:08.120372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:08.124164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:08.139936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:08.141993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:08.144457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:08.145327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:08.159762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:08.160221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:08.368953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:08.369550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:08.382658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:08.383236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:08.385835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:08.386659 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:08.387164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:08.391813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:08.454161 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=26 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:08.627191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:08.662385 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:08.671124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:08.676380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-afd76a0b-849e-45af-a058-618d6aff5039 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1341 microversion: 2.20 time: 0.311465 Sep 10 14:14:08.677988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 28/55] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:08 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1341 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:14:08.682084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:08.693903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d2d08330-e11e-4bc8-be6f-fd794aa5a8fd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1271 microversion: 2.1 time: 0.604435 Sep 10 14:14:08.709342 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 28/56] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:08 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1271 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:08.912925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:08.914032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:08.923250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:08.924474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:08.926039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:08.927002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:08.930739 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:08.931558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:08.957717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=8 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:09.110413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:09.112503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:09.144802 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:09.145957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:09.148184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:09.152624 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:09.159418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:09.160608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:09.380088 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:09.382269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=32 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:09.410967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-89389471-32f1-4b9d-a036-dd9dce5fca19 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1280 microversion: 2.1 time: 0.502235 Sep 10 14:14:09.413390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 29/57] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:08 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1280 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:09.464933 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:09.469399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:09.487524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:09.489071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:09.491548 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:09.492632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:09.507877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:09.508676 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:10.712912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:10.736896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8aad178f-c7d6-4af0-acce-26847035c2b9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 1.309216 Sep 10 14:14:10.737857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:09 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:10.755599 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:10.756213 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:10.790017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:10.790778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:10.791358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:10.796033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:10.798068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:10.798694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.023834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:11.032269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8c05fd87-15a3-4bd9-9706-4e087ebafa37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 1.926515 Sep 10 14:14:11.032854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:09 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:11.056909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:11.057517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:11.080015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.081758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.084596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.086089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.086903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.087743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.116561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:11.158686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:11.169953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:11.178556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0a4fdbae-88d9-49af-92d8-691887488c40 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1339 microversion: 2.20 time: 0.428451 Sep 10 14:14:11.181089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 31/60] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:10 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1339 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:11.188098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:11.188950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:11.203713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.204681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.205302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.206212 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.206842 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.207457 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.401780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:11.416223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-76d1a672-146e-42e0-9820-0cae6f591a0c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1280 microversion: 2.1 time: 0.230332 Sep 10 14:14:11.416223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 32/61] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:11 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:11.560115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149", "tag": "59ef42f3-b123-4299-94f1-580410905a1d"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:11.595855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.596789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.597456 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.625618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Creating event network-changed:59ef42f3-b123-4299-94f1-580410905a1d for instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 on hv-cinder-85690 Sep 10 14:14:11.626577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 14:14:11.627208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-11a29a96-a790-4dbb-b994-ba9171ebe01c req-98a53355-c719-4408-945b-6f85acbc95b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 14:14:11.628519 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.629283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.629931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.630872 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.636551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.637372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.648851 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.compute.rpcapi [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 14:14:11.650099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] Releasing lock "compute-rpcapi-router" {{(pid=120616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 14:14:11.669763 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-df55fec2-a3fa-4a84-9fd4-bc094219ed1f None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236241 Sep 10 14:14:11.671006 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 33/62] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:11.763101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:11.764064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:11.776753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.777469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.780571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:11.781474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:11.782432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:11.783343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:12.526116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:12.538189 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3b615217-8fbc-4a2a-95df-4dd0608ae3f8 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 1.489947 Sep 10 14:14:12.540574 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 30/63] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:11 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:12.564142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:12.565749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:12.574348 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:12.575907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:12.576528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:12.577403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:12.578015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:12.578778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:13.871175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:13.886662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-30f6a7a6-3e34-47b5-b571-f72f0a9ebc3f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 2.126789 Sep 10 14:14:13.890524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 34/64] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:11 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:13.897186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:13.898221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:13.906953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:13.907916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:13.908672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:13.910585 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:13.911729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:13.912539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:14.281555 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:14.291393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2d39eaae-ff99-4020-ac44-c8350838d25c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 1.737197 Sep 10 14:14:14.292000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 31/65] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:12 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:14.297121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:14.300158 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:14.327026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:14.331883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:14.332413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:14.333387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:14.335826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:14.338479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:14.938605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:14.957546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:14.962884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:14.972856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-61977d23-49da-4072-836a-9b7cd5eef3c5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 1.076035 Sep 10 14:14:14.976738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 35/66] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:13 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:14.986075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:14.992414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:15.012352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:15.013021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:15.013474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:15.014248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:15.014695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:15.015129 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:15.529329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:15.541250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9bb4b893-fa96-40b1-a100-a2dda3062f59 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 1.247835 Sep 10 14:14:15.556226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:14 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:15.581808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:15.582726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:15.596245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:15.598104 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:15.598769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:15.600655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:15.603040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:15.603836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.047977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:16.060331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-defc8474-d762-4843-b790-4486d624167a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 1.080251 Sep 10 14:14:16.062807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 36/68] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:14 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:16.069444 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:16.070454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:16.084145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.084642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.086829 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.087659 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.088169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.088604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.356550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:16.365725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b4fea622-d0ca-47cd-9be8-e109070dc60f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.792438 Sep 10 14:14:16.367263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 33/69] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:15 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:16.373162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:16.373780 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:16.386732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.397269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.399172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.401596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.402477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.405629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.571393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:16.589388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6bb7e4a7-3930-4067-a455-85a17fb48342 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.523881 Sep 10 14:14:16.591609 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 37/70] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:16 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:16.607530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:16.613202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:16.624355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.625106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.626201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.627492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.628114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.628899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.710866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:16.725424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:16.727117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:16.728441 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d9aa73fe-16e9-4011-89fb-26780062b1bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.360236 Sep 10 14:14:16.729733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 34/71] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:16 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:16.817728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0ca05e-16d2-4457-8d89-e994e419ab5d", "tag": "e6fcbbfc-9671-414f-875a-f64e6f7cb859"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:16.832443 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.832930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.833543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.857227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Creating event network-changed:e6fcbbfc-9671-414f-875a-f64e6f7cb859 for instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d on hv-cinder-85690 Sep 10 14:14:16.858582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 14:14:16.859061 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-823844f5-8332-4c4a-a30d-e1da0945ec0e req-b534025f-cc61-4546-b479-5fba99c41742 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 14:14:16.860446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.861346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.862008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.862878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:16.863505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:16.864093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:16.874689 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.compute.rpcapi [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 14:14:16.875594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] Releasing lock "compute-rpcapi-router" {{(pid=120617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 14:14:16.893144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ada11c7f-8dbc-4d9b-ae45-02fb471e6d03 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161841 Sep 10 14:14:16.894057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 35/72] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:16.990677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:17.013369 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f3109e12-5629-47a3-876d-4077c4594cd4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.419788 Sep 10 14:14:17.015999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:16 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:17.087372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:17.088270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:17.096488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.097136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.097931 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.098843 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.099607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.100413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.334369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:17.347614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fd97dbbe-ecdb-4f46-bdf4-4d9c90c97c46 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.266429 Sep 10 14:14:17.348814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 36/74] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:17 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:17.394868 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:17.396221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:17.403540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.404692 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.405392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.406235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.406891 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.407665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.476717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-8a6e94ff-8f4a-4a0e-8fb3-5f81c3c2edc0 req-219c6efa-7d97-4ba4-bdf9-5e4ae111c9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2854a3-80bf-4f48-b3ac-bd7da137ed28", "tag": "b57abb22-a3a4-4796-a68e-0be41a2d509d"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:17.489521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-8a6e94ff-8f4a-4a0e-8fb3-5f81c3c2edc0 req-219c6efa-7d97-4ba4-bdf9-5e4ae111c9f1 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.490003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-8a6e94ff-8f4a-4a0e-8fb3-5f81c3c2edc0 req-219c6efa-7d97-4ba4-bdf9-5e4ae111c9f1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.491002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-8a6e94ff-8f4a-4a0e-8fb3-5f81c3c2edc0 req-219c6efa-7d97-4ba4-bdf9-5e4ae111c9f1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.507625 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-8a6e94ff-8f4a-4a0e-8fb3-5f81c3c2edc0 req-219c6efa-7d97-4ba4-bdf9-5e4ae111c9f1 service nova] Creating event network-changed:b57abb22-a3a4-4796-a68e-0be41a2d509d for instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 on hv-cinder-85690 Sep 10 14:14:17.517626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-8a6e94ff-8f4a-4a0e-8fb3-5f81c3c2edc0 req-219c6efa-7d97-4ba4-bdf9-5e4ae111c9f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049595 Sep 10 14:14:17.518629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 37/75] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:17.615241 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:17.616166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:17.626330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.626885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.627252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.627983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.628434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.628852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.778614 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:17.789875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ba9b8c2f-4fd1-4b02-9d1b-8b3bfcac2db5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.402189 Sep 10 14:14:17.791764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 39/76] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:17 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:17.800186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:17.801257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:17.809194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.810069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.810528 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:17.812223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:17.813003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:17.813583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.072627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:18.086356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2891412a-cf8f-4828-bb09-388026285054 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.475464 Sep 10 14:14:18.087668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 38/77] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:17 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:18.094229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:18.095367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:18.104116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.105139 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.106566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.107400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.108024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.108554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.155861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:18.164386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:18.165838 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:18.166950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e4694e41-dc52-47f7-ae72-72632010944c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.374097 Sep 10 14:14:18.179691 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 40/78] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:17 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:18.256625 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:18.267672 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e3f489e0-8f3a-4813-bb6b-5be9a3dc400c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.178294 Sep 10 14:14:18.268261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 39/79] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:18 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:18.379074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:18.379845 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:18.388732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.389380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.389823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.390522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.390980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.391404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.560782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:18.568376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-fbceb301-de1a-4bb5-909d-eedd0c90745c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.193165 Sep 10 14:14:18.576519 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 41/80] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:18 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:18.818941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:18.820631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:18.827556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.828414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.828854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.829547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.829991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.830632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.937760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1b2a0b-e748-4e8f-aa8b-ea9ded131152", "tag": "7a0a5b67-06da-47fc-8dba-8dd6bdde132d"}, {"name": "network-changed", "server_uuid": "4d02053b-770b-4632-bbb2-f8867cb62341", "tag": "1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:18.957419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:18.958161 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:18.958608 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:18.980376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] Creating event network-changed:7a0a5b67-06da-47fc-8dba-8dd6bdde132d for instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 on hv-cinder-85690 Sep 10 14:14:18.984341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] Creating event network-changed:1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e for instance 4d02053b-770b-4632-bbb2-f8867cb62341 on hv-cinder-85690 Sep 10 14:14:19.004571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-5679a11c-059b-406f-aaf1-19e42aa78172 req-3b25033a-c58a-4d7f-be80-9da4d44c9a4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070105 Sep 10 14:14:19.005179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 42/81] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:14:19.045876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.056977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fd831257-5c96-46fb-9d1d-6f3fecbc4317 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.242968 Sep 10 14:14:19.057715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 40/82] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:18 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:19.116831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:19.117706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:19.127761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.128452 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.129220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.129926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.130443 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.130862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.196820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:19.198268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:19.207560 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.208301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.208912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.209918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.210661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.211654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.379755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.389500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c315583c-4a38-419d-9916-cc5cfb0e36b2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.279817 Sep 10 14:14:19.404522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 43/83] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:19 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:19.412510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:19.412660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:19.417898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.420501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.421150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.422385 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.423538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.423703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.424134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.439936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.442201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.444013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-daf6a2a8-089d-410c-9089-f1f6da1cfbe0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.253338 Sep 10 14:14:19.444745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 41/84] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:19 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:19.537816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-43409f56-15d3-41aa-ab39-e86aab22b35c req-58428024-a494-4f48-96e2-6a298fab7f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:19.555974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-43409f56-15d3-41aa-ab39-e86aab22b35c req-58428024-a494-4f48-96e2-6a298fab7f30 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.556473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-43409f56-15d3-41aa-ab39-e86aab22b35c req-58428024-a494-4f48-96e2-6a298fab7f30 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.556916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-43409f56-15d3-41aa-ab39-e86aab22b35c req-58428024-a494-4f48-96e2-6a298fab7f30 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.573583 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-43409f56-15d3-41aa-ab39-e86aab22b35c req-58428024-a494-4f48-96e2-6a298fab7f30 service nova] Creating event network-changed:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:14:19.579230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-43409f56-15d3-41aa-ab39-e86aab22b35c req-58428024-a494-4f48-96e2-6a298fab7f30 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045637 Sep 10 14:14:19.580089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 42/85] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:19.593302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:19.594229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:19.600590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.601084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.601521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.602222 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:19.602677 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:19.603099 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:19.639039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.642968 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:19.651123 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a18bf8e3-5599-44f2-86fa-b3548f57b840 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.259103 Sep 10 14:14:19.663663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:19 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:19.755960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:19.765260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c84dca73-45a7-4dd6-bb00-00a10eef7fe2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.176756 Sep 10 14:14:19.765845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 43/87] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:19 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:20.083559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:20.084382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:20.090397 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.091492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.092085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.092821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.093434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.093852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.263970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:20.272555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-72d2d073-a27d-4dcf-8d0c-20d5175ca567 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.193762 Sep 10 14:14:20.273140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:20 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:20.414000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:20.414612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:20.421563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.422149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.422671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.423495 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.424119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.424743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.472872 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:20.473978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:20.481901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.482873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.483572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.484494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.485230 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.485854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.616143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:20.638730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6b4f8c6a-c5f7-4944-8fa9-3e4aaea10703 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.223256 Sep 10 14:14:20.648762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:20 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:20.680059 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:20.680739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:20.694146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.694721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.696427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.697464 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.698199 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.698958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.743454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:20.761397 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:20.764496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:20.766604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3284c527-614a-44b8-a077-77995fe4a57a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.299222 Sep 10 14:14:20.767589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 46/90] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:20 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:20.796801 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:20.797435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:20.804458 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.804978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.805534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:20.806189 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:20.806646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:20.807071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:21.130522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:21.148030 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-51867bb8-9576-4c0e-9d1f-eb731b754943 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.476281 Sep 10 14:14:21.148628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:20 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:21.296939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:21.297556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:21.315218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:21.315402 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:21.315816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:21.316258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:21.316967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:21.317427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:21.317857 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:21.322474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:21.331741 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-62d2d27a-a21b-445a-9987-567525b23563 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.535130 Sep 10 14:14:21.332554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 47/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:20 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:21.708372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:21.708990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:21.733296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:21.743907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:21.744483 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:21.745039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:21.745872 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:21.746435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:21.747082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.002787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.013046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8668363d-97c9-41ef-9232-62b30688b205 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.720460 Sep 10 14:14:22.014531 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 46/93] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:21 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:22.019602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:22.020465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:22.029027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:22.029808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:22.030244 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.031042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:22.031517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:22.032239 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.360635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.369907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.371474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.372619 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b6d0f876-b062-44b5-872e-3eed2a55a4eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.356794 Sep 10 14:14:22.373375 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 47/94] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:22 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:22.375224 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.378129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:22.378735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:22.385687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:22.386976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-97f2f43e-0a90-481f-826e-b851c25e4e6c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.682379 Sep 10 14:14:22.387172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:22.388145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.389311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:22.390000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:22.390667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.390907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 48/95] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:21 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:22.396148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:22.397013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:22.405324 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:22.406037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:22.406612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.407748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:22.408377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:22.408920 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:22.634115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.672027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:22.677247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-deb3b240-c7f8-4104-91d3-6d0890b096a2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.284412 Sep 10 14:14:22.678226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 48/96] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:22 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:22.696200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4bac15d8-fd85-4dda-a027-dc32b508c2d3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.303947 Sep 10 14:14:22.697388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 49/97] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:22 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:23.040126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:23.040721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:23.047134 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.047664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.048093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.048782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.049230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.049647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.265817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.283342 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d0779413-d3ff-4c67-b129-df5c50bed4bc tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.246858 Sep 10 14:14:23.285505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 49/98] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:23 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:23.408818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:23.409348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:23.415841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:23.416576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:23.416946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.417664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.418102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.418960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.419541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.419957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.429060 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.430470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.431851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.432989 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.434879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.435698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.628409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.637338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.646930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.648828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.650346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-56da54b8-e60c-4e21-974e-981aa04037a7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.255879 Sep 10 14:14:23.651621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 50/99] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:23 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:23.665398 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b25805f3-e696-49c6-aa2f-a5a012cb4c99 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.254478 Sep 10 14:14:23.666101 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 50/100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:23 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:23.704512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:23.705665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:23.716166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.717031 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.717782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.726092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:23.726946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:23.730850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.732191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.732494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.739882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.740583 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.741166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.742022 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:23.743789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:23.745828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:23.938934 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.939419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:23.949979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-68e50db8-67cf-4045-9ea9-5dd361a734d1 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.228461 Sep 10 14:14:23.951611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:23 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:23.956578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-85eba496-750b-430c-a1c2-eb7182fd2a36 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.259425 Sep 10 14:14:23.957175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 51/102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:23 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:24.316299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:24.316909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:24.325386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:24.326541 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:24.326985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:24.327717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:24.328178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:24.328604 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:24.679087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:24.680762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:24.688598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:24.689561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:24.690637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:24.691647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:24.692541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:24.693542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:24.757755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:24.773617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-95b638e0-53a1-4368-b48d-8dc57c076207 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.461482 Sep 10 14:14:24.783539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 52/103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:24 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:24.783539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:24.783539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:24.792533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:24.795090 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:24.797397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:24.801247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:24.802409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:24.804193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:24.911085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:24.924057 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:24.927007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:24.928846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ab90a1f3-76db-449f-af68-38d8198d763e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.255191 Sep 10 14:14:24.930526 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 52/104] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:24 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:25.033901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-180cf76b-79e1-467c-88e5-78889c79b378 req-613bd879-f6c7-4686-818d-7c60cd312e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149", "name": "network-vif-plugged", "status": "completed", "tag": "59ef42f3-b123-4299-94f1-580410905a1d"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:25.043777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-180cf76b-79e1-467c-88e5-78889c79b378 req-613bd879-f6c7-4686-818d-7c60cd312e78 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.044487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-180cf76b-79e1-467c-88e5-78889c79b378 req-613bd879-f6c7-4686-818d-7c60cd312e78 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.045089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-180cf76b-79e1-467c-88e5-78889c79b378 req-613bd879-f6c7-4686-818d-7c60cd312e78 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.056551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-180cf76b-79e1-467c-88e5-78889c79b378 req-613bd879-f6c7-4686-818d-7c60cd312e78 service nova] Creating event network-vif-plugged:59ef42f3-b123-4299-94f1-580410905a1d for instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 on hv-cinder-85690 Sep 10 14:14:25.062308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-180cf76b-79e1-467c-88e5-78889c79b378 req-613bd879-f6c7-4686-818d-7c60cd312e78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095658 Sep 10 14:14:25.063239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 53/105] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:14:25.069297 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:25.070087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:25.076910 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.077493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.078159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.078913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.079437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.079969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.228672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:25.238363 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-70f09b0c-1ed5-4292-864d-8967c17fe458 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.173769 Sep 10 14:14:25.239259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 54/106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:25 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:25.250612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:25.252003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:25.263243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.265070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.266098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.267175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.268942 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.270124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.378237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:25.390715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ed97a0da-200e-497b-823c-1aa751dd3747 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.614408 Sep 10 14:14:25.391831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 53/107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:24 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:25.442664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:25.450365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-045e35e2-a649-4989-99ed-d0cfa016d5d9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.209775 Sep 10 14:14:25.450948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 55/108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:25 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:25.807814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:25.808638 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:25.818747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.819485 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.822538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.823483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.824250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.826335 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.955380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:25.956917 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:25.974246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.974941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.975572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:25.977042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:25.978407 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:25.979958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.090873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:26.104120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3f274646-a297-4786-a64d-5965dde651b7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.309045 Sep 10 14:14:26.104936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 54/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:25 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:26.174816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:26.191287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:26.193322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:26.194706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-01735ce7-f2c0-4797-945f-fab0d7cd27d3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.243520 Sep 10 14:14:26.208885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 56/110] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:25 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:26.264586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:26.265197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:26.274283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:26.274758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:26.275377 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.276034 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:26.276556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:26.279092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.417143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:26.420191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:26.434125 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:26.436583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:26.439015 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.441009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:26.442469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:26.442469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.498197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:26.519948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4db4302a-d065-4aad-9ced-56cc99789406 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.259382 Sep 10 14:14:26.521445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 55/111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:26 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:26.540853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:26.541459 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:26.548350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:26.549653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:26.551259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.552191 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:26.553001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:26.554871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:26.873211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:27.097901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.112282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2def090e-aed1-4e9e-96f3-dfc78d3a7dc9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.701847 Sep 10 14:14:27.113686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 57/112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:26 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:27.136933 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:27.138796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:27.149922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:27.155777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:27.156698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:27.157446 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:27.157997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:27.158517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:27.247984 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.263249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-04ba0718-3769-4e8f-89ce-d0a291eaa474 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.736466 Sep 10 14:14:27.286557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 56/113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:26 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:27.298311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:27.299827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:27.312432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:27.313264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:27.314007 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:27.314916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:27.315748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:27.317947 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:27.590801 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.611649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-68ae39e1-b724-4add-a2bf-a6d0b8929135 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.478831 Sep 10 14:14:27.628181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 58/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:27 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:27.636884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:27.638284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:27.647263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:27.648052 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:27.648704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:27.649986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:27.650936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:27.651736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:27.661469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.672631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.674360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.676414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-034a9d0c-876a-4d2a-9843-19b7723820c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.385876 Sep 10 14:14:27.677546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 57/115] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:27 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:27.832883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:27.841761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-34f412d5-4901-4f9f-8558-971cb6cbba43 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.212052 Sep 10 14:14:27.842610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 59/116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:27 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:28.138306 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:28.139803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:28.145831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.146496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.147119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.148004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.148629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.149702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.296577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:28.298718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:28.310631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.315302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.315798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.316507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.317285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:28.320575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.321267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.328743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b465ac03-37b9-45ab-9985-cb3663ca2c15 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.195586 Sep 10 14:14:28.329370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 58/117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:28 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:28.504162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:28.512941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3da150c9-1fcb-412e-b420-5f70de9cd222 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.220866 Sep 10 14:14:28.513698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 60/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:28 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:28.642438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:28.643317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:28.651958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.653760 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.654893 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.655715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.656467 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.656951 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.702381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:28.703297 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:28.715806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.716566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.717180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.718220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.719221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.719843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.903637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:28.913905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0d8c47ac-2ded-4663-b3d5-bd4db6b2e7ac tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.277679 Sep 10 14:14:28.914492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 59/119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:28 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:28.922341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:28.923112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:28.931199 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.932017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.933055 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.934865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:28.936083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:28.937173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:28.942976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:28.956389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:28.957906 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:28.959791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-238467d8-dc43-44cd-979b-93ee8095b5d1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.261881 Sep 10 14:14:28.960695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 61/120] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:28 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:14:29.109041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:29.116827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b7cb6fa9-6f5c-4770-bf62-b8c4e80005a3 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.200137 Sep 10 14:14:29.117571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 60/121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:28 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:29.140626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-1cddb9ba-2f44-4284-803e-c3cff6ae119a req-f89a5cff-df95-4a80-847b-5c08aa75bf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1b2a0b-e748-4e8f-aa8b-ea9ded131152", "name": "network-vif-plugged", "status": "completed", "tag": "7a0a5b67-06da-47fc-8dba-8dd6bdde132d"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:29.152050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-1cddb9ba-2f44-4284-803e-c3cff6ae119a req-f89a5cff-df95-4a80-847b-5c08aa75bf5a service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.154843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-1cddb9ba-2f44-4284-803e-c3cff6ae119a req-f89a5cff-df95-4a80-847b-5c08aa75bf5a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.155317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-1cddb9ba-2f44-4284-803e-c3cff6ae119a req-f89a5cff-df95-4a80-847b-5c08aa75bf5a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.159987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:29.170560 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-1cddb9ba-2f44-4284-803e-c3cff6ae119a req-f89a5cff-df95-4a80-847b-5c08aa75bf5a service nova] Creating event network-vif-plugged:7a0a5b67-06da-47fc-8dba-8dd6bdde132d for instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 on hv-cinder-85690 Sep 10 14:14:29.180757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-1cddb9ba-2f44-4284-803e-c3cff6ae119a req-f89a5cff-df95-4a80-847b-5c08aa75bf5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046880 Sep 10 14:14:29.182013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 62/122] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:29.352431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:29.353181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:29.363187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.363915 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.364399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.365088 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.365564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.366310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.538892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:29.539627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:29.553108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.554169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.555274 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.556021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.556792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.559469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.560320 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:29.570458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1c3f35e7-94a4-4a98-9ea9-61ef554bd316 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.221384 Sep 10 14:14:29.571780 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 61/123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:29 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:29.771612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:29.783325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-41e2a56b-ee1d-4942-b361-774985588a03 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.248683 Sep 10 14:14:29.786334 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 63/124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:29 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:29.941093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:29.942064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:29.948564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.949046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.950093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.950789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:29.951411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:29.951990 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:29.994669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:29.995215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:30.002200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.002654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.003079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.003804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.004250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.004657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.141431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:30.147642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:30.150623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:30.152383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:30.154170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-07f6ed14-9b68-453b-b313-1426b5ac10b5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.163291 Sep 10 14:14:30.155257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 64/125] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:29 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:14:30.156588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:30.159747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d6c5ea83-c51b-4cc2-a1f7-d98d5cf986cd tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.222447 Sep 10 14:14:30.171936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 62/126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:29 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:30.185848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:30.188959 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:30.196435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.197712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.198382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.199497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.200271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.202703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.392250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:30.401037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-000cf24d-6815-4286-9054-bfc38b8c00ec tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.244440 Sep 10 14:14:30.401624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 65/127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:30 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:30.599983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:30.600641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:30.622116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.622608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.623044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.624038 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.624507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.624934 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.823722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:30.828955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:30.838529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=99 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:30.843194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.844171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.849387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.851598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:30.853663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:30.854884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:30.941937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:30.960079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e7bbd72a-d56b-420a-82b9-0d7582426633 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.362694 Sep 10 14:14:30.975674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 63/128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:30 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:31.150496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:31.163109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1e633ecd-fe2a-4518-80d1-a5dbe4a9b33d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.347471 Sep 10 14:14:31.164282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 66/129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:30 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:31.180789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:31.181830 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:31.189604 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.190855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.191882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.193242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.193984 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.194554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.196117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:31.196478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:31.213623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.214443 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.214901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.223704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.224296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.226968 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.428856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:31.435531 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:31.437778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:31.439734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f7e6a5ea-986b-46c6-99e7-2f9c8e8f6b4a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.263457 Sep 10 14:14:31.440289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 64/130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:31 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:31.456151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-16e74e0c-a525-4b81-916b-35d9b866650d req-ce1dfa6e-d26f-46d9-9e0b-f2e1da1bcccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d02053b-770b-4632-bbb2-f8867cb62341", "name": "network-vif-plugged", "status": "completed", "tag": "1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:31.470899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-16e74e0c-a525-4b81-916b-35d9b866650d req-ce1dfa6e-d26f-46d9-9e0b-f2e1da1bcccb service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.471738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-16e74e0c-a525-4b81-916b-35d9b866650d req-ce1dfa6e-d26f-46d9-9e0b-f2e1da1bcccb service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.472170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-16e74e0c-a525-4b81-916b-35d9b866650d req-ce1dfa6e-d26f-46d9-9e0b-f2e1da1bcccb service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.487109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-16e74e0c-a525-4b81-916b-35d9b866650d req-ce1dfa6e-d26f-46d9-9e0b-f2e1da1bcccb service nova] Creating event network-vif-plugged:1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e for instance 4d02053b-770b-4632-bbb2-f8867cb62341 on hv-cinder-85690 Sep 10 14:14:31.492549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-16e74e0c-a525-4b81-916b-35d9b866650d req-ce1dfa6e-d26f-46d9-9e0b-f2e1da1bcccb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051116 Sep 10 14:14:31.493271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 65/131] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:31.501323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:31.502223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:31.509784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.510612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.511192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.512310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.513505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.514270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.516984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:31.528356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-16022493-6af1-4aa8-9b20-ae453b04a0f8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.341701 Sep 10 14:14:31.529161 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 67/132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:31 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:31.671929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:31.682688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c4fc3ae3-0759-49e0-8d8c-6f05803609d5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.188029 Sep 10 14:14:31.684723 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:31 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:31.987626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:31.988248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:31.996521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.997257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.997990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:31.998705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:31.999164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:31.999623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.166734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:32.176025 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-65c1dda5-eaee-4766-93a7-856f52fc894b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.194634 Sep 10 14:14:32.190601 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 68/134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:31 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:32.191276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:32.191276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:32.197445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.197836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.198272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.198957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.199503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.200065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.393156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:32.405390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-aefe6a6d-0554-48ba-8db1-f0c230ad6d7e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.218304 Sep 10 14:14:32.412420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 67/135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:32 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:32.474728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:32.475753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:32.486709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.487186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.488318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.490319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.491073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.491675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.555070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:32.556374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:32.564784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.565568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.566575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.567373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.567869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.568299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.675487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:32.686429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:32.688164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:32.690572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9e8fd0a2-fe04-497b-8f3e-f80a26a19fe9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.220213 Sep 10 14:14:32.691348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 69/136] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:32 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:32.715050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:32.717186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:32.724470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.725163 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.725769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.726651 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:32.727273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:32.728972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:32.812529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:32.822560 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f0729619-f2b9-49f0-ab77-19c159bfcaa6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.272056 Sep 10 14:14:32.842922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:32 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:33.030069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:33.037757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-415a98af-4fb0-468a-a00d-a91d50d6f617 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.327169 Sep 10 14:14:33.047159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 70/138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:32 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:33.205848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:33.207362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:33.215290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.216251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.216774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.217607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.218185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.218703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.445045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:33.445847 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:33.453972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.454689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.455366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.456293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.457562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.458193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.500924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:33.524731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-57b1c298-1e6f-416d-acfc-d7a225a69130 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1367 microversion: 2.1 time: 0.323175 Sep 10 14:14:33.525713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 69/139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:33 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:33.531262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-0d1ce98c-7a2e-4a4e-bc60-956cdd5a8ce7 req-ef929766-b4e3-4a28-a024-5584597d9305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2854a3-80bf-4f48-b3ac-bd7da137ed28", "name": "network-vif-plugged", "status": "completed", "tag": "b57abb22-a3a4-4796-a68e-0be41a2d509d"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:33.541079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0d1ce98c-7a2e-4a4e-bc60-956cdd5a8ce7 req-ef929766-b4e3-4a28-a024-5584597d9305 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.541580 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0d1ce98c-7a2e-4a4e-bc60-956cdd5a8ce7 req-ef929766-b4e3-4a28-a024-5584597d9305 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.542009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0d1ce98c-7a2e-4a4e-bc60-956cdd5a8ce7 req-ef929766-b4e3-4a28-a024-5584597d9305 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.555113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-0d1ce98c-7a2e-4a4e-bc60-956cdd5a8ce7 req-ef929766-b4e3-4a28-a024-5584597d9305 service nova] Creating event network-vif-plugged:b57abb22-a3a4-4796-a68e-0be41a2d509d for instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 on hv-cinder-85690 Sep 10 14:14:33.564038 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-0d1ce98c-7a2e-4a4e-bc60-956cdd5a8ce7 req-ef929766-b4e3-4a28-a024-5584597d9305 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036630 Sep 10 14:14:33.565222 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 70/140] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:33.659240 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:33.666844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9b831033-181b-492f-a521-41a94bacf177 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.235704 Sep 10 14:14:33.667771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 71/141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:33 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:33.718308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:33.719259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:33.725447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.725963 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.726400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.727130 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.727622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.728045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.847732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:33.848540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:33.857333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.858042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.858831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.860259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:33.860915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:33.861827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:33.868029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:33.878077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:33.880524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:33.881684 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e0475957-8f68-4e29-8745-9d301513d539 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.168373 Sep 10 14:14:33.888078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 71/142] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:33 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:34.034093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:34.041727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f0b69187-7f32-43da-964b-bec8e5d7753b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.198532 Sep 10 14:14:34.042287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 72/143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:33 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:34.063847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:34.064462 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:34.070454 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.070929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.071357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.072168 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.072623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.073040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.206698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:34.214454 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8e7b6371-0ea7-47aa-b50b-026bcb0d0dac tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.156193 Sep 10 14:14:34.215570 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 72/144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:34 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:34.547726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:34.548291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:34.554215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.554693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.555122 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.555823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.556284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.556700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.688172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:34.689094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:34.689700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:34.695665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.695946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8aa25fbc-4488-453a-9048-2892fa8b2c1b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1556 microversion: 2.1 time: 0.152221 Sep 10 14:14:34.696144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.696513 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 73/145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:34 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:34.696620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.697300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.697757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.698175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.719833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:34.720337 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:34.726145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.726629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.727062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.727786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.728242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.728664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.843124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:34.852945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b46cd76c-4609-4ead-8a73-f9c8ae222be7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.167605 Sep 10 14:14:34.853099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bde1a393-553b-4794-b7ff-99d7d388045f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137612 Sep 10 14:14:34.853946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 73/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:34 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:34.855649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 74/147] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:14:34 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:14:34.908599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:34.910163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:34.918151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.918923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.919542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:34.920469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:34.921632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:34.922261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:35.069549 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:35.070758 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:35.079278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:35.080305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:35.081453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:35.082597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:35.083337 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:35.083980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:35.239808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:35.259128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:35.260582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:35.262639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:35.263806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-55bf713b-72ff-4daf-ac2c-171d41011c4b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.359739 Sep 10 14:14:35.264884 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 74/148] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:34 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:35.269452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:35.270053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:35.274866 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-80f8e85b-02f5-450f-a12e-f64cdc8d5d85 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.211268 Sep 10 14:14:35.276166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:35.276808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:35.277446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:35.278979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:35.279596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:35.280153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:35.284789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 75/149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:35 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:35.612586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:35.620469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bf4f2e99-4758-432e-9fb1-38de38676178 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.354583 Sep 10 14:14:35.621040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:35 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:35.876546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:35.877121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:35.883471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:35.883965 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:35.884395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:35.885208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:35.885663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:35.886081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.025381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.035854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1671294b-0a3f-4538-baeb-ba75fc261f84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.163181 Sep 10 14:14:36.036804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 76/151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:35 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:36.130897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1367747511", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "networks": [{"uuid": "855cd864-d80a-423b-a501-515f11abd589"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:36.187600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] validate_networks() for [('855cd864-d80a-423b-a501-515f11abd589', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:14:36.290289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:36.290972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:36.297892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.298379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.298834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.299560 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.300047 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.300466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.435987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.444676 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.446212 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.447332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1b5eea4a-fe63-4b2e-a2d3-127c6e26e15e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.161350 Sep 10 14:14:36.447939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 77/152] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:36 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:36.453149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:36.453754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:36.459982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.460472 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.460907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.461598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.462054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.462477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.608998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.617755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7187707f-c09a-44f6-91ab-a5a005ad36f6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.168204 Sep 10 14:14:36.618417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 78/153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:36 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:36.644800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:36.645320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:36.651732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.652223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.653190 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.654232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.654690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.655112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.758288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:14:36.758838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:14:36.759157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:14:36.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:14:36.760194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:14:36.762792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=99 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:36.771851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.772547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.773136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.774120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.774753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.775343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.793802 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Getting quotas for project e3a9c95bc33f4697917a9e8c53f78a98. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:14:36.797081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.798790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Getting quotas for user 8f468d0b1fec4502858b8e29ac640ebd and project e3a9c95bc33f4697917a9e8c53f78a98. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:14:36.801120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:36.806083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-66ef5940-cde1-4872-8ffd-06eadc88fecd tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.165512 Sep 10 14:14:36.806984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 79/154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:36 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:36.811948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-a761e4bb-5c5f-435b-be61-7a84c8c3fc6e req-103d3643-4845-4c8b-b8ec-0c5b4b29bc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149", "tag": "59ef42f3-b123-4299-94f1-580410905a1d"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:36.821840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-a761e4bb-5c5f-435b-be61-7a84c8c3fc6e req-103d3643-4845-4c8b-b8ec-0c5b4b29bc7c service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:36.822510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-a761e4bb-5c5f-435b-be61-7a84c8c3fc6e req-103d3643-4845-4c8b-b8ec-0c5b4b29bc7c service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:36.822940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-a761e4bb-5c5f-435b-be61-7a84c8c3fc6e req-103d3643-4845-4c8b-b8ec-0c5b4b29bc7c service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:36.825813 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:14:36.828202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:14:36.834598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-a761e4bb-5c5f-435b-be61-7a84c8c3fc6e req-103d3643-4845-4c8b-b8ec-0c5b4b29bc7c service nova] Creating event network-changed:59ef42f3-b123-4299-94f1-580410905a1d for instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 on hv-cinder-85690 Sep 10 14:14:36.839726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-a761e4bb-5c5f-435b-be61-7a84c8c3fc6e req-103d3643-4845-4c8b-b8ec-0c5b4b29bc7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031423 Sep 10 14:14:36.841253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 80/155] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:36.879137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-331f8221-d158-430f-8cbb-3840fa0ed066 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752086 Sep 10 14:14:36.880156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 76/156] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:14:36.893071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c229690d-98c7-43a4-b3c9-9303449d3cfa tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:36.894048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c229690d-98c7-43a4-b3c9-9303449d3cfa tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:36.952940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c229690d-98c7-43a4-b3c9-9303449d3cfa tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:36.960854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c229690d-98c7-43a4-b3c9-9303449d3cfa tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1219 microversion: 2.1 time: 0.072515 Sep 10 14:14:36.961532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 81/157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:36 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:37.058399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:37.059132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:37.065700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.066622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.067499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.069539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.070643 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.071644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.235858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:37.243920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3b01f6fd-76f6-46c1-b874-5257e191cf96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.189605 Sep 10 14:14:37.244683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:37 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:37.472929 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:37.473639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:37.479976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.480463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.481394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.482364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.482842 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.483287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.619953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:37.629384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:37.630832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:37.631975 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-94ee1a16-fff4-465c-be41-48108e8fe33f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.163027 Sep 10 14:14:37.632844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 82/159] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:37 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:37.647777 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:37.648391 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:37.658871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.659728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.660380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.661180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.661699 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.662126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.797322 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:37.804911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1a153312-0164-47b1-93b0-b6f8a63cf98e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.167530 Sep 10 14:14:37.805481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:37 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:37.829258 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:37.829915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:37.835696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.836171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.836598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.837280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.837727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.838140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.976603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:37.985475 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:37.985649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ca628013-80f7-4fb7-8d50-0a8f8d667751 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.160101 Sep 10 14:14:37.986067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 83/161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:37 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:37.986421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:37.992514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.992995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.993424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:37.994109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:37.994556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:37.994974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.059808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:38.067759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-21692e8a-d19e-4f1f-b415-634665012db5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1223 microversion: 2.1 time: 0.087056 Sep 10 14:14:38.068323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 79/162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:37 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:38.269111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:38.269653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:38.275562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:38.276048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:38.276481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.278198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:38.278617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:38.279049 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.409203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:38.416776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8973b67c-8850-423a-87f1-bc8468029b74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.151577 Sep 10 14:14:38.417340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 84/163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:38 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:38.657194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:38.657789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:38.663775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:38.664247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:38.664671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.665367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:38.665807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:38.666220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.794601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:38.802603 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:38.804045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:38.805159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-00080f2d-785a-4161-af1c-6ecdeb7c792e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.151835 Sep 10 14:14:38.805712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 80/164] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:38 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:38.829185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:38.829798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:38.835762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:38.836242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:38.836672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.837354 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:38.837807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:38.838229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:38.969554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:38.977153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-535ece3b-bdad-4627-b3cb-f0c077da9955 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.152810 Sep 10 14:14:38.977712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 85/165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:38 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:39.008591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:39.010289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:39.017110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.017725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.018164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.018853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.019313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.019771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.038897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:39.093841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:39.094623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:39.101894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.102453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.103211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.104011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.104531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.105162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.156111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:39.164657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2768cdca-e882-41cc-a69f-41a16a3e8419 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.159855 Sep 10 14:14:39.165553 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 81/166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:39 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:39.172948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:39.180956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3947e6d3-102f-41b6-a155-fac2d8afb1f3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1223 microversion: 2.1 time: 0.092839 Sep 10 14:14:39.181524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 86/167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:39 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:39.439813 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:39.440419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:39.446422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.446898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.447330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.448116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.449148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.450152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.591128 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:39.598911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d496dfa3-1e46-4500-ac94-38e5e1b359c1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.163039 Sep 10 14:14:39.599508 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 82/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:39 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:39.830220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:39.830824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:39.837155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.837629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.838062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.838785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:39.839172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:39.839632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:39.982506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:39.990516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:39.992026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:39.993200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c7f862ad-2323-4f78-b26f-3936d05d8c80 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.167074 Sep 10 14:14:39.993980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 87/169] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:39 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:40.000664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:40.001267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:40.007110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.007625 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.008055 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.008720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.009166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.009577 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.135848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:40.143393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9b9eb2b4-ed9c-4c9e-b212-6e9f58b88fd7 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.147542 Sep 10 14:14:40.143982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 83/170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:39 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:40.188087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:40.188695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:40.194531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.195005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.195432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.196130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.196604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.197025 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.203299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:40.203932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:40.209759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.210234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.210662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.211337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.211845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.212259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.277874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:40.286273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5107ba80-c8d9-4199-8662-956f9904d0ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1223 microversion: 2.1 time: 0.086705 Sep 10 14:14:40.286928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 84/171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:40 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:40.346114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:40.353683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-be2acbc7-0205-432e-b632-a61afeb6f9cb tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.169417 Sep 10 14:14:40.354531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 88/172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:40 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:40.624910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:40.625867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:40.639738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.640334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.641050 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.642059 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:40.642818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:40.643411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:40.917651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:40.927322 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fc028010-d0f1-4b85-98d8-2319194feca8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.308566 Sep 10 14:14:40.928324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 85/173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:40 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:41.020822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:41.021536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:41.028530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.029235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.029988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.031301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.032278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.032857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.168559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:41.169408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:41.176116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.176782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.177395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.178243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.178943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.179374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.193979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:41.203105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:41.204599 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:41.205718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bb51ce9b-66dd-4fb4-aa2e-e82170d6f54e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.188944 Sep 10 14:14:41.206277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 89/174] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:41 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:41.225027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-5fc00ae9-86cc-4067-a0a2-019f578c54ee req-2a91d727-2432-4a01-b0f9-c5bee26d066d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "name": "network-vif-plugged", "status": "completed", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:41.235394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5fc00ae9-86cc-4067-a0a2-019f578c54ee req-2a91d727-2432-4a01-b0f9-c5bee26d066d service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.235908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5fc00ae9-86cc-4067-a0a2-019f578c54ee req-2a91d727-2432-4a01-b0f9-c5bee26d066d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.236338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5fc00ae9-86cc-4067-a0a2-019f578c54ee req-2a91d727-2432-4a01-b0f9-c5bee26d066d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.248337 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-5fc00ae9-86cc-4067-a0a2-019f578c54ee req-2a91d727-2432-4a01-b0f9-c5bee26d066d service nova] Creating event network-vif-plugged:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:14:41.253442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-5fc00ae9-86cc-4067-a0a2-019f578c54ee req-2a91d727-2432-4a01-b0f9-c5bee26d066d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Sep 10 14:14:41.254787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 90/175] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:14:41.311955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:41.312371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:41.318496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.318976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.319401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.320105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.320547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.320958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.326314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:41.333912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fc3c2b82-ee04-4c65-96d0-176f20ee73bb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.169791 Sep 10 14:14:41.334490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 86/176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:41 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:41.376758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:41.377372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:41.383277 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.383798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.384232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.385012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.385469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.385905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.388778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:41.397045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8633d6c1-3048-483b-8c33-a794d2b966c3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.090584 Sep 10 14:14:41.397695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 91/177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:41 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:41.519078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:41.526942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-66d80b7b-bb6c-4b1e-bc60-0019626fc20a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.154153 Sep 10 14:14:41.527886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 87/178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:41 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:41.950461 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:41.951065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:41.956931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.957405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.957834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:41.958500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:41.958948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:41.959359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.099992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.108070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3244b7f8-4f03-4e37-8e65-95540bf765b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.161789 Sep 10 14:14:42.108669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 92/179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:41 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:42.231306 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:42.232356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:42.238151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.238634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.239076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.239758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.240200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.240802 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.357068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:42.357677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:42.367314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.368004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.368544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.369246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.369915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.370377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.392405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.409300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.410823 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.411985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-558be455-4147-4f6d-88b7-be131295a912 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.184814 Sep 10 14:14:42.412600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 88/180] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:42 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:42.420344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:42.420947 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:42.438836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.439422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.439962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.440983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.441481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.441972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.524204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.531086 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.536117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d3e0408f-f71e-4074-a1b7-b0131819eee7 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.118925 Sep 10 14:14:42.536752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:42 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:42.542320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c3f8ae6e-cf54-438c-b4f0-eb226f9b6b7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1363 microversion: 2.1 time: 0.189271 Sep 10 14:14:42.543417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 93/182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:42 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:42.560282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:42.561419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:42.568584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.568995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.569498 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.570179 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:42.570621 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:42.571052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:42.716097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:42.723944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bd9fa6cf-22e8-4e31-a060-5fe3e2987217 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.171035 Sep 10 14:14:42.724544 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 90/183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:42 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:43.133017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:43.133967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:43.143990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.145144 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.145658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.146495 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.147017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.148092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.290808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-dc8dfafe-b5d2-433c-bc71-e7084a118035 req-8ebb5bfc-f3e6-4b5f-9a36-414b6a027e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0ca05e-16d2-4457-8d89-e994e419ab5d", "name": "network-vif-plugged", "status": "completed", "tag": "e6fcbbfc-9671-414f-875a-f64e6f7cb859"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:43.316006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dc8dfafe-b5d2-433c-bc71-e7084a118035 req-8ebb5bfc-f3e6-4b5f-9a36-414b6a027e2f service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.316878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dc8dfafe-b5d2-433c-bc71-e7084a118035 req-8ebb5bfc-f3e6-4b5f-9a36-414b6a027e2f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.316878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dc8dfafe-b5d2-433c-bc71-e7084a118035 req-8ebb5bfc-f3e6-4b5f-9a36-414b6a027e2f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.333463 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-dc8dfafe-b5d2-433c-bc71-e7084a118035 req-8ebb5bfc-f3e6-4b5f-9a36-414b6a027e2f service nova] Creating event network-vif-plugged:e6fcbbfc-9671-414f-875a-f64e6f7cb859 for instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d on hv-cinder-85690 Sep 10 14:14:43.337974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:43.338601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-dc8dfafe-b5d2-433c-bc71-e7084a118035 req-8ebb5bfc-f3e6-4b5f-9a36-414b6a027e2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064058 Sep 10 14:14:43.339548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 91/184] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:14:43.351883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dddd4f49-1777-4785-8e6d-576e1bf050e6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.223186 Sep 10 14:14:43.352584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 94/185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:43 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:43.439376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:43.440213 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:43.447174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.447713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.448160 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.448848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.450057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.450626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.561785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:43.562635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:43.576322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.576878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.577422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.578030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.578648 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.579064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.616482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:43.626775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:43.628521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:43.629919 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-875f3b9e-b58c-43c9-b85d-ddd359a4f25f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.194639 Sep 10 14:14:43.630955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 92/186] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:43 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:43.635502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:43.636103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:43.645405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.645903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.646335 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.647025 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.647692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.648122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.673032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:43.681177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-88232246-a021-4ec5-b8ae-4f58023446a2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.125696 Sep 10 14:14:43.681766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 95/187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:43 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:43.753781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:43.754734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:43.761510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.762549 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.763178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.764080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.764831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.765410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.814785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:43.828336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-66a8a158-9445-43c7-9b98-e1d9cf1432e1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1549 microversion: 2.1 time: 0.196140 Sep 10 14:14:43.829316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 93/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:43 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1549 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:43.874273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:43.874273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:43.897172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.897964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.899845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:43.900927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:43.901875 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:43.902729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.015304 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:44.026328 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-85eebe1c-f16d-4990-8a26-e925b9d5c067 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.276222 Sep 10 14:14:44.026915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 96/189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:43 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:44.093587 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-30c6ddcf-6c9a-45ba-9219-b85bc645e866 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229795 Sep 10 14:14:44.094271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 94/190] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:14:43 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:44.375144 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:44.376426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:44.382399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:44.382945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:44.383307 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.384015 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:44.384525 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:44.385151 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.530955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:44.543474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d26dd012-e858-4ac5-89f2-e734bf7f3f3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.171610 Sep 10 14:14:44.554099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 97/191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:44 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:44.655589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:44.656200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:44.662970 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:44.663859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:44.665044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.665755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:44.666985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:44.667409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.703658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:44.704573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:44.711009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:44.711625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:44.712152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.712913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:44.713534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:44.713958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:44.778660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:44.782229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:44.788071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d9ed4567-7def-48b5-861f-ccb2d7a0c76e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.087856 Sep 10 14:14:44.788891 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 98/192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:44 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:45.050113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:45.051606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:45.058075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.058793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.059461 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.060462 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.061249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.061367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:45.061998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.070865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:45.073140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:45.074818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-03077db6-2691-47e4-a3fe-9e61b972afa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.423145 Sep 10 14:14:45.075385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 95/193] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:44 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:45.203887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:45.213810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-946a4923-f3fe-42fa-869e-8bcae62dd00d tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.167794 Sep 10 14:14:45.214485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 99/194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:45 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:45.503932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-25857224-9a71-407d-a0bd-90dc7a1f9c0b req-5cdec624-b963-4025-b599-76712168bc80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d02053b-770b-4632-bbb2-f8867cb62341", "tag": "1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:45.517501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-25857224-9a71-407d-a0bd-90dc7a1f9c0b req-5cdec624-b963-4025-b599-76712168bc80 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.518465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-25857224-9a71-407d-a0bd-90dc7a1f9c0b req-5cdec624-b963-4025-b599-76712168bc80 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.519791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-25857224-9a71-407d-a0bd-90dc7a1f9c0b req-5cdec624-b963-4025-b599-76712168bc80 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.534403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-25857224-9a71-407d-a0bd-90dc7a1f9c0b req-5cdec624-b963-4025-b599-76712168bc80 service nova] Creating event network-changed:1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e for instance 4d02053b-770b-4632-bbb2-f8867cb62341 on hv-cinder-85690 Sep 10 14:14:45.542121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-25857224-9a71-407d-a0bd-90dc7a1f9c0b req-5cdec624-b963-4025-b599-76712168bc80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043275 Sep 10 14:14:45.544110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 96/195] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:45.570230 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:45.570900 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:45.577948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.578824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.579869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.580929 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.581421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.581853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.810377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:45.816635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:45.818288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:45.818540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f5ee1277-d2f4-4332-9b2f-6a9a58784bb9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1322 microversion: 2.1 time: 0.252172 Sep 10 14:14:45.819345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 100/196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:45 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:45.831101 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.831605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.832036 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.832975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:45.833426 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:45.833852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:45.951852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:45.959822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-452ccd44-c34f-4289-809c-f96d69dec275 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.149260 Sep 10 14:14:45.960388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 97/197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:45 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:46.100285 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:46.101093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:46.107731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:46.108542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:46.109197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:46.110269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:46.111316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:46.111996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:46.238008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:46.238629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:46.253641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:46.254142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:46.254581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:46.255294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:46.255774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:46.256201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:46.358673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:46.367801 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:46.369343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:46.370566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1076a4bc-3223-4d2c-9905-9155851c1928 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.274133 Sep 10 14:14:46.372066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 101/198] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:46 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:14:46.785183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:46.800696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:46.807646 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:46.811355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-17d60396-536e-43b0-a27a-d7d9a1df5029 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.577214 Sep 10 14:14:46.811959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 98/199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:46 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:46.853580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:46.855007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:46.866137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:46.867097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:46.867809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:46.868595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:46.869127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:46.869761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:46.957947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:46.986176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:46.986750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:47.000447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.000972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.001416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.002311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.002773 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.003201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.029874 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.040898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-18dffa68-aec1-4801-b431-96820494517c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1516 microversion: 2.1 time: 0.192784 Sep 10 14:14:47.041654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 102/200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:46 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:47.073252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:47.076440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:47.082431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.082913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.083345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.084082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.087069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.087966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.088610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.091431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:47.096590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-005b727c-d218-43e5-9d2d-d29fe1a12256 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.116166 Sep 10 14:14:47.097231 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 99/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:46 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:47.113205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'flavor' on Instance uuid 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:14:47.234440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0002e375-b222-4899-b810-2cdbf4e7334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28/action" status: 200 len: 32 microversion: 2.1 time: 0.165488 Sep 10 14:14:47.235076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 103/202] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:14:47 2022] POST /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:14:47.244694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:47.245436 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:47.252815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.253293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.253718 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.254399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.254909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.255387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.398688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:47.399391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:47.406158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.406657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.407102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.407823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.408448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.409030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.423952 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.437893 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ea6a609c-bd3c-4484-9bb9-88c8c98acaf1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.196954 Sep 10 14:14:47.442149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 100/203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:47 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:47.551646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.560667 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.562111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.563219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1ba81433-4240-4815-8198-dd05dc9c4005 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1407 microversion: 2.20 time: 0.168762 Sep 10 14:14:47.563898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 104/204] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:47 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:14:47.838095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:47.838713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:47.845291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.845775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.846212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.846904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:47.847370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:47.847821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:47.984130 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:47.991956 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a38432fe-db85-4c43-ad6b-53838280bc78 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.157616 Sep 10 14:14:47.992823 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 101/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:47 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:48.120573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:48.122302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:48.129130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.130341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.130977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.132211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.132824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.133402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.208273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:48.217244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-482898d1-f0bc-4289-8b2a-c7648b18b1a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1271 microversion: 2.1 time: 0.100697 Sep 10 14:14:48.231923 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 105/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:48 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:48.464091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:48.464726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:48.471007 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.471520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.472180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.472866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.473311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.474023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.595117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:48.596144 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:48.602916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.604399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.605027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.606388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.607314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.607999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.645119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:48.655800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f7d6f631-ce92-45f1-978f-8589a7ce000d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.195356 Sep 10 14:14:48.656370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 102/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:48 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:48.803861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:48.812833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:48.814282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:48.815617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c85cca26-7ba1-427a-be2b-b0c5f4dece9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1600 microversion: 2.20 time: 0.230931 Sep 10 14:14:48.816370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 106/208] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:14:48 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:14:48.844028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:48.844724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:48.851290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.851871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.852365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.853283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:48.853807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:48.854467 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:48.954105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-64550beb-93f2-40c3-a997-c907957fb0d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115016 Sep 10 14:14:48.954938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 103/209] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 10 14:14:48 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:14:49.018451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:49.019385 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:49.030342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:49.030840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:49.031261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:49.031984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:49.032429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:49.032843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:49.221996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:49.233513 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d4e1ffb4-0b51-417a-9b2f-71b835e391b2 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.219613 Sep 10 14:14:49.234733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:49 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:49.244349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:49.246093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:49.259270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:49.261100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:49.261853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:49.262582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:49.263853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:49.264294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:49.401753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:49.414987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a0219e92-e8e2-4e6b-90d0-cda5eeec08a6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1279 microversion: 2.1 time: 0.176882 Sep 10 14:14:49.428325 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 104/211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:49 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:49.687183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:49.690703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:49.697757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:49.699844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:49.700982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:49.702016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:49.702669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:49.703384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:49.881881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:49.893473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3b9f7424-108f-49b5-b6ed-2dc70795d270 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.216764 Sep 10 14:14:49.894076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 108/212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:49 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:50.264457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:50.265946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:50.281077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:50.281750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:50.282288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:50.284352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:50.296073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:50.296576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:50.446067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:50.447318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:50.456270 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:50.457060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:50.457728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:50.458646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:50.459311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:50.459972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:50.607734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:50.624311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-70c203bd-0c86-4a0c-8e1c-f1c131d8e466 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1277 microversion: 2.1 time: 0.179454 Sep 10 14:14:50.642252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 109/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:50 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:50.928399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:50.928399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:50.935133 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:50.935682 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:50.936474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:50.937327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:50.937927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:50.938534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:51.101250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:51.111170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a319ce73-13cc-4620-b8d4-9255f637b686 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.196868 Sep 10 14:14:51.112466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 110/214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:50 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:51.146580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-d0491645-a990-42a2-9e9b-214cf6b94a2b req-c5bc3955-18d5-401d-ad5f-fa38763cfb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:51.150175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:51.158056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d0491645-a990-42a2-9e9b-214cf6b94a2b req-c5bc3955-18d5-401d-ad5f-fa38763cfb2b service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:51.159065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d0491645-a990-42a2-9e9b-214cf6b94a2b req-c5bc3955-18d5-401d-ad5f-fa38763cfb2b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:51.159737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d0491645-a990-42a2-9e9b-214cf6b94a2b req-c5bc3955-18d5-401d-ad5f-fa38763cfb2b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:51.164772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8335f445-5459-47a4-87aa-7d1389fcf26e tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1313 microversion: 2.1 time: 0.906976 Sep 10 14:14:51.166541 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 105/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:50 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:51.198229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-d0491645-a990-42a2-9e9b-214cf6b94a2b req-c5bc3955-18d5-401d-ad5f-fa38763cfb2b service nova] Creating event network-changed:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:14:51.204599 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-d0491645-a990-42a2-9e9b-214cf6b94a2b req-c5bc3955-18d5-401d-ad5f-fa38763cfb2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062136 Sep 10 14:14:51.212496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 111/216] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:51.648368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:51.650445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:51.657681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:51.658395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:51.659008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:51.659756 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:51.660360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:51.660931 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:51.813909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:51.823401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ea9b486e-92f5-4dbb-921a-b9b8413939da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1277 microversion: 2.1 time: 0.178802 Sep 10 14:14:51.824054 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 106/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:51 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:52.140447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:52.142177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:52.155237 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:52.161057 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:52.161912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:52.163268 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:52.165752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:52.166485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:52.197398 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:52.198206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:52.205688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:52.206187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:52.206631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:52.207323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:52.207814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:52.208236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:52.616806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:52.626634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0d580e7b-6065-4623-9f21-5039d1af03b5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1499 microversion: 2.1 time: 0.432770 Sep 10 14:14:52.628108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 107/218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:52 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1499 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:52.677439 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:52.688841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4495842b-0b38-4a4f-b4d3-cc2fbd0992a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.557137 Sep 10 14:14:52.690218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:52 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:52.846860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:52.847484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:52.854858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:52.856060 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:52.857341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:52.858439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:52.859011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:52.859682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:53.083821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:53.094451 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bd758454-1f4a-44e7-8a67-a72477a398de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.250582 Sep 10 14:14:53.095738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 108/220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:52 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:53.390399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-569d4e76-3a2d-4a91-8c0a-378ef9c8ebdc req-ad72c326-2598-4964-9e0e-1ebc498acec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c097854-5050-4604-b9cf-4904586ead26", "tag": "07cd3df2-b597-494d-ae14-abe706937316"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:53.400591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-569d4e76-3a2d-4a91-8c0a-378ef9c8ebdc req-ad72c326-2598-4964-9e0e-1ebc498acec4 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:53.401636 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-569d4e76-3a2d-4a91-8c0a-378ef9c8ebdc req-ad72c326-2598-4964-9e0e-1ebc498acec4 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:53.402972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-569d4e76-3a2d-4a91-8c0a-378ef9c8ebdc req-ad72c326-2598-4964-9e0e-1ebc498acec4 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:53.414948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-569d4e76-3a2d-4a91-8c0a-378ef9c8ebdc req-ad72c326-2598-4964-9e0e-1ebc498acec4 service nova] Creating event network-changed:07cd3df2-b597-494d-ae14-abe706937316 for instance 6c097854-5050-4604-b9cf-4904586ead26 on hv-cinder-85690 Sep 10 14:14:53.420780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-569d4e76-3a2d-4a91-8c0a-378ef9c8ebdc req-ad72c326-2598-4964-9e0e-1ebc498acec4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034727 Sep 10 14:14:53.421392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 113/221] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:14:53.712613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:53.713222 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:53.719423 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:53.719940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:53.720373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:53.721224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:53.722011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:53.722445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:53.857211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:53.866256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d4d1afa3-ed9d-4e2a-856d-e4aa23ffb55a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.157473 Sep 10 14:14:53.866825 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:53 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:54.118974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:54.119743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:54.126425 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:54.126900 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:54.127329 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:54.128030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:54.128474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:54.128885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:54.256010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:54.259610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:54.264716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0717f203-7409-4887-96b5-47c2f3227bd1 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.149963 Sep 10 14:14:54.265281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 114/223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:54 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:54.890966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:54.891602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:54.897671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:54.898102 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:54.898534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:54.899216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:54.899696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:54.900120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:55.029005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:55.037119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-99497c52-13b0-4891-9d70-2b37645a1e18 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.150677 Sep 10 14:14:55.037675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:54 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:55.288458 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:55.289063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:55.290840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:14:55.298067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:55.298554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:55.298986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:55.299698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:55.300146 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:55.300567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:55.430731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:55.438681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-68e5a49d-51ee-4fe9-93e3-dc032c7a9258 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.155012 Sep 10 14:14:55.439248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:55 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:56.060753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:56.061366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:56.067142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:56.067660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:56.068095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:56.068773 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:56.069225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:56.069644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:56.200084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:56.207737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2a5ccd03-d79c-4078-a93a-ce58e26978ee tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.151422 Sep 10 14:14:56.208311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 111/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:56 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:56.461261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:56.461869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:56.467954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:56.468432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:56.468865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:56.469540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:56.469986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:56.470404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:56.595804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:56.603264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-120eb758-2379-48b6-bc1e-6dbc2d37168b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.145890 Sep 10 14:14:56.603852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 116/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:56 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:57.229882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:57.230639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:57.237738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:57.238223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:57.238743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:57.239430 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:57.239980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:57.240445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:57.367233 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:57.375798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4cfe084c-5603-4702-87b5-d1e9e65b482d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.149675 Sep 10 14:14:57.376363 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 112/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:57 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:57.626315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:57.626882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:57.632943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:57.633424 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:57.633855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:57.634537 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:57.634986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:57.635405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:57.769941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:57.777586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-56e15105-5430-4318-be7e-cd38d4133f22 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.155270 Sep 10 14:14:57.778147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 117/229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:57 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:58.398833 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:58.399371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:58.405363 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:58.405842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:58.406273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:58.406954 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:58.407407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:58.407858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:58.536741 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:58.545056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1881f174-6a8b-4526-bc86-c90cfb39d389 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.150118 Sep 10 14:14:58.545617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 113/230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:58 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:58.802557 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:58.803161 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:58.810003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:58.810490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:58.810926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:58.811687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:58.812142 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:58.812567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:58.939535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:58.947123 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-590ff99d-604d-4174-8022-ceb902469963 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.148452 Sep 10 14:14:58.947729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 118/231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:58 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:14:59.323472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e789080b-aec4-49f5-87be-bca7677ac717"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:14:59.326628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:59.332572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:59.333056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:59.333488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:59.334165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:59.334615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:59.335028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:59.568675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:59.569277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:59.576030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:59.576505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:59.576948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:59.577634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:59.578077 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:59.578487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:59.714134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:14:59.725683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d1a49545-cf38-4055-87b7-ffe699f455bb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.160800 Sep 10 14:14:59.726262 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 119/232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:59 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:14:59.969819 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:14:59.970429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:14:59.976367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:59.976851 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:59.977289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:14:59.977975 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:14:59.978442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:14:59.978849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:00.114204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:00.122942 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7e2a502e-d638-4aa7-a14d-a5587ce343ba tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.157074 Sep 10 14:15:00.123526 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 120/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:14:59 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:00.749134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:00.749759 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:00.755740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:00.756222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:00.756652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:00.757336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:00.757784 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:00.758203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:01.072762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:01.082607 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ac99a5e2-8bb4-45a3-8c4e-6d688401be88 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.337420 Sep 10 14:15:01.096433 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 121/234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:00 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:01.149140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:01.150681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:01.158929 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:01.161121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:01.161947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:01.163068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:01.164089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:01.165131 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:01.277474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4a955d6c-d2ca-441f-9ed6-5bade263aac6 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "POST /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.957558 Sep 10 14:15:01.278901 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 114/235] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:14:59 2022] POST /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d/os-volume_attachments => generated 194 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:15:01.364930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:01.378008 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-16573f06-79bb-4d18-a080-5e5dd3f49643 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.234283 Sep 10 14:15:01.388308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 122/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:01 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:02.112683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:02.113486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:02.121100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:02.121547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:02.122037 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:02.122791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:02.123253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:02.123698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:02.142700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:02.257974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:02.266450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a628c86c-b456-46e5-9194-58f15d81334c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.159237 Sep 10 14:15:02.267019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 115/237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:02 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:02.401901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:02.403059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:02.409249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:02.409729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:02.410163 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:02.410844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:02.411310 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:02.411768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:02.545193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:02.552830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a21af238-5f3f-4707-94cc-65329705c90c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.154834 Sep 10 14:15:02.553399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 123/238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:02 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:03.289683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:03.290392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:03.297175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:03.297667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:03.298111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:03.298808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:03.299264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:03.299729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:03.440800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:03.448582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b72127f6-b5f1-4bd5-b98e-9bd836d11643 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.162704 Sep 10 14:15:03.449389 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 116/239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:03 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:03.576940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:03.577785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:03.584120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:03.584643 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:03.585075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:03.585749 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:03.586286 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:03.586836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:03.720712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:03.728381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bd41ed99-4698-4a22-9fcf-2e444848413e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.156002 Sep 10 14:15:03.728957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 124/240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:03 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:04.472121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:04.472791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:04.479234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:04.479779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:04.480206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:04.481457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:04.482479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:04.482926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:04.615913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:04.624373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8e454ccc-700d-4d75-bf0d-71b0eb541c00 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.156390 Sep 10 14:15:04.624933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 117/241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:04 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:04.752186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:04.752793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:04.758628 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:04.759090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:04.759617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:04.760300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:04.760746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:04.761163 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:04.894433 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:04.902106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-175e4bbf-a835-47d4-8db7-46d09b796a06 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.153768 Sep 10 14:15:04.903234 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 125/242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:04 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:05.422074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-0867abc5-d8ef-42a7-8b72-2b6313b6e44e req-89c2f29e-4839-48cb-ad64-af0ff9f7fb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c097854-5050-4604-b9cf-4904586ead26", "name": "network-vif-plugged", "status": "completed", "tag": "07cd3df2-b597-494d-ae14-abe706937316"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:05.431726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0867abc5-d8ef-42a7-8b72-2b6313b6e44e req-89c2f29e-4839-48cb-ad64-af0ff9f7fb0f service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:05.432181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0867abc5-d8ef-42a7-8b72-2b6313b6e44e req-89c2f29e-4839-48cb-ad64-af0ff9f7fb0f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:05.432600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0867abc5-d8ef-42a7-8b72-2b6313b6e44e req-89c2f29e-4839-48cb-ad64-af0ff9f7fb0f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:05.445121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-0867abc5-d8ef-42a7-8b72-2b6313b6e44e req-89c2f29e-4839-48cb-ad64-af0ff9f7fb0f service nova] Creating event network-vif-plugged:07cd3df2-b597-494d-ae14-abe706937316 for instance 6c097854-5050-4604-b9cf-4904586ead26 on hv-cinder-85690 Sep 10 14:15:05.450519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-0867abc5-d8ef-42a7-8b72-2b6313b6e44e req-89c2f29e-4839-48cb-ad64-af0ff9f7fb0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 Sep 10 14:15:05.451235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 118/243] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:15:05.647715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:05.648572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:05.655387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:05.655916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:05.656351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:05.657042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:05.657617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:05.658039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:05.805589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:05.813998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-063f1c36-f7a4-4c9e-bd19-8f58959ba2c5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.170499 Sep 10 14:15:05.814730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 126/244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:05 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:05.926706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:05.927420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:05.933765 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:05.934285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:05.934720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:05.935414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:05.935958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:05.936982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:06.113869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:06.121731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-019509f0-fc04-4e1d-96af-7c605b020ffc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.199562 Sep 10 14:15:06.122932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 119/245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:05 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:06.838097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:06.838709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:06.844590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:06.845070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:06.845506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:06.846194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:06.846647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:06.847062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:06.985044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:06.993399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e2d63696-59f0-4347-81b6-32fc4953dd6e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.159445 Sep 10 14:15:06.994062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 127/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:06 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:07.144652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:07.145274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:07.147804 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:07.153587 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:07.154079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:07.154516 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:07.155207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:07.155713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:07.156141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:07.298194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:07.305951 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-694d62b1-c121-4fff-b748-76b97bd513a5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.165135 Sep 10 14:15:07.306507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 120/247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:07 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:08.016698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:08.017386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:08.023331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:08.023878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:08.024320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:08.025006 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:08.025459 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:08.025886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:08.164553 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:08.173062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ec0311e2-ab4c-4d5b-ac2a-7090364162b7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.160300 Sep 10 14:15:08.173634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 128/248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:08 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:08.329182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:08.329968 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:08.336400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:08.336882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:08.337316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:08.338005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:08.338456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:08.338878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:08.490755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:08.500566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-509052d2-be25-4064-954c-df6f18e328de tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1319 microversion: 2.1 time: 0.175484 Sep 10 14:15:08.501165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 121/249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:08 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:09.196110 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:09.196662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:09.203350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:09.203881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:09.204315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:09.205039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:09.205490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:09.205911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:09.337198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:09.345647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f37b9836-9e5e-4f64-a84e-17151d783407 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.153505 Sep 10 14:15:09.346218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 129/250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:09 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:09.522336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:09.522898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:09.529393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:09.529870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:09.530307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:09.530986 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:09.531521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:09.531879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:09.658637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:09.666180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5cb589b9-8fd7-4f60-9505-dcc09a803157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1508 microversion: 2.1 time: 0.147706 Sep 10 14:15:09.666743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 122/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:09 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:10.368421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:10.369033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:10.375214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:10.375725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:10.376158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:10.376848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:10.377480 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:10.377908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:10.510414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:10.519594 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dbc1a3db-d7df-421d-83ac-ba239f86a91d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.154756 Sep 10 14:15:10.520156 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 130/252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:10 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:11.544762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:11.545375 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:11.554364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:11.555185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:11.555652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:11.556490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:11.557080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:11.557668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:11.721739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:11.729533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0ec4ad9d-3f6d-4e3d-96ca-46b124539046 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.190416 Sep 10 14:15:11.730107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 123/253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:11 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:12.077009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:12.077584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:12.083336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:12.083850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:12.084279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:12.084962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:12.085410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:12.085827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:12.104488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:12.111928 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:15:12.196790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7bab130d-d0c8-4780-aa51-a03dd1efaf26 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 204 len: 0 microversion: 2.1 time: 0.123379 Sep 10 14:15:12.197684 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 131/254] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:15:12 2022] DELETE /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:15:12.205825 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:12.206434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:12.212353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:12.212826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:12.213257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:12.213927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:12.214369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:12.214786 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:12.345962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:12.354956 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b07c47d6-8649-47b4-bea6-7eea95eaa58f tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1551 microversion: 2.1 time: 0.152816 Sep 10 14:15:12.355548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 124/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:12 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:12.756013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:12.756623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:12.762600 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:12.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:12.763536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:12.764222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:12.764672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:12.765090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:12.900802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:12.909004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-94be9d69-4665-4bb1-bf89-8bdcad50568d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.157390 Sep 10 14:15:12.909575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 132/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:12 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:13.381032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:13.381648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:13.389444 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:13.389989 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:13.390458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:13.391227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:13.391721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:13.392141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:13.524512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:13.532991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b6821530-80a7-4078-b49c-8ba25cb9d7b7 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1551 microversion: 2.1 time: 0.156014 Sep 10 14:15:13.533559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 125/257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:13 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:13.931067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:13.931746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:13.938483 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:13.938961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:13.939391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:13.940102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:13.940547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:13.940961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:14.069044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:14.077744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9479384b-a3a8-406a-b3ec-492487386fc5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.150491 Sep 10 14:15:14.078308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 133/258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:13 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:14.558548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:14.559456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:14.567135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:14.567843 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:14.568281 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:14.568967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:14.570260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:14.570695 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:14.705818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:14.714499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-92edb6e7-2b07-416d-aaf2-c72d8fc2cc05 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1551 microversion: 2.1 time: 0.160622 Sep 10 14:15:14.715077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 126/259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:14 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:15.101625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:15.103048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:15.110900 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:15.111395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:15.111856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:15.112614 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:15.113101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:15.113531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:15.243369 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:15.252343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2983d808-656e-440c-849e-9183d48cc6ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.154827 Sep 10 14:15:15.252915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 134/260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:15 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:15.738818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:15.739419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:15.746085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:15.746574 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:15.747039 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:15.747791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:15.748247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:15.748713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:15.987227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:15.995972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cf53f2cb-d3fc-4891-8681-b39abbc4b6d9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1551 microversion: 2.1 time: 0.260970 Sep 10 14:15:15.996684 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 127/261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:15 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1551 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:16.274956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:16.275705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:16.284033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:16.287865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:16.288623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:16.289486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:16.290972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:16.291718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:16.331886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-5334c161-3266-4882-8193-3dd97d1a24a7 req-4ff3b875-4865-410e-9c05-0df91223b98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0ca05e-16d2-4457-8d89-e994e419ab5d", "name": "network-vif-deleted", "tag": "e6fcbbfc-9671-414f-875a-f64e6f7cb859"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:16.345557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-5334c161-3266-4882-8193-3dd97d1a24a7 req-4ff3b875-4865-410e-9c05-0df91223b98e service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:16.345997 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-5334c161-3266-4882-8193-3dd97d1a24a7 req-4ff3b875-4865-410e-9c05-0df91223b98e service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:16.346428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-5334c161-3266-4882-8193-3dd97d1a24a7 req-4ff3b875-4865-410e-9c05-0df91223b98e service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:16.380733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-5334c161-3266-4882-8193-3dd97d1a24a7 req-4ff3b875-4865-410e-9c05-0df91223b98e service nova] Creating event network-vif-deleted:e6fcbbfc-9671-414f-875a-f64e6f7cb859 for instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d on hv-cinder-85690 Sep 10 14:15:16.387227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-5334c161-3266-4882-8193-3dd97d1a24a7 req-4ff3b875-4865-410e-9c05-0df91223b98e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066167 Sep 10 14:15:16.387878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 128/262] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:15:16.536389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:16.544345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e4a3225f-479e-4783-a918-b9387758efb2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.273622 Sep 10 14:15:16.544961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 135/263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:16 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:17.021769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:17.022742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:17.030382 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:17.030922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:17.031790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:17.032763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:17.034364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:17.034987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:17.074790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:17.075285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:17.075748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:17.076519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lazy-loading 'fault' on Instance uuid 3d0ca05e-16d2-4457-8d89-e994e419ab5d {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:15:17.131096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca58aca3f9d4d8fa9f1c6315db7f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06101fb7de2e4338967b29365e713677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:17.140653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1620f175-89ee-447d-8650-81ac15e562a5 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 200 len: 1349 microversion: 2.1 time: 0.124133 Sep 10 14:15:17.141502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 129/264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:17 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 1349 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:17.568808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:17.569445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:17.575314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:17.575820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:17.576244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:17.576924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:17.577364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:17.577782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:17.791010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:17.804894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4b2120c6-68e1-4f82-acd2-11d0eef809ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.240031 Sep 10 14:15:17.805678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 136/265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:17 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:18.170601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:18.171205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:18.177804 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:18.178284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:18.178718 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:18.179412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:18.179889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:18.180309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:18.194529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] HTTP exception thrown: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Request method failure captured: Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d HTTP/1.1 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuehYSjmKnXA60ke4fcNoAQCObDkWiv9BlraukX__xgqdHNPaFGFnlG7PjV7tDKs3FJWxEUHsdXyenhb9jYBXmrgiAVgjIxjcfkZTa2yJl37GrtQryQJDANFCUs952d5fr8yIPBZSOzrO-gryiODtfMG68QCIgxmAoSmHcuXB5n188 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:15:18.207330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06101fb7de2e4338967b29365e713677", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06101fb7de2e4338967b29365e713677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}] Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 5ca58aca3f9d4d8fa9f1c6315db7f54d Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.209265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '3d0ca05e-16d2-4457-8d89-e994e419ab5d'} Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:15:18.210087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.211557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.212826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Returning 404 to user: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:15:18.212826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-634bf300-8d6e-41e3-800e-1eb8ed5b9fb9 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 404 len: 111 microversion: 2.1 time: 0.042283 Sep 10 14:15:18.212826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 130/266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:18 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 14:15:18.330073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:18.332454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:18.338585 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:18.339082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:18.339590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:18.340326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:18.341221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:18.341649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:18.356769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] HTTP exception thrown: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Request method failure captured: Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d/os-volume_attachments HTTP/1.1 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuehYSjmKnXA60ke4fcNoAQCObDkWiv9BlraukX__xgqdHNPaFGFnlG7PjV7tDKs3FJWxEUHsdXyenhb9jYBXmrgiAVgjIxjcfkZTa2yJl37GrtQryQJDANFCUs952d5fr8yIPBZSOzrO-gryiODtfMG68QCIgxmAoSmHcuXB5n188 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:15:18.361581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06101fb7de2e4338967b29365e713677", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06101fb7de2e4338967b29365e713677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}] Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 5ca58aca3f9d4d8fa9f1c6315db7f54d Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.363020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'server_id': '3d0ca05e-16d2-4457-8d89-e994e419ab5d'} Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:15:18.367269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:18.368661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:18.370148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Returning 404 to user: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:15:18.370148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-23da5b56-7abc-4b0b-a89e-a546602b8f3a tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036931 Sep 10 14:15:18.370148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 137/267] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:15:18 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:15:18.829241 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:18.830166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:18.836292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:18.836772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:18.837209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:18.837948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:18.838396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:18.838814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:19.066642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:19.074870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a109e103-e249-4352-b6f3-1cff4aea32ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.249645 Sep 10 14:15:19.075457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 131/268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:18 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:19.598145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:19.598678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:19.605833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:19.606561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:19.607318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:19.608209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:19.608899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:19.609550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:19.632597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] HTTP exception thrown: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Request method failure captured: Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d HTTP/1.1 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuehYSjmKnXA60ke4fcNoAQCObDkWiv9BlraukX__xgqdHNPaFGFnlG7PjV7tDKs3FJWxEUHsdXyenhb9jYBXmrgiAVgjIxjcfkZTa2yJl37GrtQryQJDANFCUs952d5fr8yIPBZSOzrO-gryiODtfMG68QCIgxmAoSmHcuXB5n188 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:15:19.634646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06101fb7de2e4338967b29365e713677", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06101fb7de2e4338967b29365e713677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}] Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 5ca58aca3f9d4d8fa9f1c6315db7f54d Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.635837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '3d0ca05e-16d2-4457-8d89-e994e419ab5d'} Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:15:19.636500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.637543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.638708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Returning 404 to user: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:15:19.638708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-80e93678-6534-4e4d-a513-2535c0c8af31 tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 404 len: 111 microversion: 2.1 time: 0.043118 Sep 10 14:15:19.638708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 138/269] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:15:19 2022] DELETE /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:15:19.645879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:19.646492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] [instance: 3d0ca05e-16d2-4457-8d89-e994e419ab5d] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:19.654578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:19.655069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:19.655532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:19.656235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:19.656709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:19.657235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:19.685932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] HTTP exception thrown: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Request method failure captured: Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d HTTP/1.1 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuehYSjmKnXA60ke4fcNoAQCObDkWiv9BlraukX__xgqdHNPaFGFnlG7PjV7tDKs3FJWxEUHsdXyenhb9jYBXmrgiAVgjIxjcfkZTa2yJl37GrtQryQJDANFCUs952d5fr8yIPBZSOzrO-gryiODtfMG68QCIgxmAoSmHcuXB5n188 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:15:19.688499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06101fb7de2e4338967b29365e713677", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06101fb7de2e4338967b29365e713677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06101fb7de2e4338967b29365e713677"}]}] Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 06101fb7de2e4338967b29365e713677 Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-DeleteServersTestJSON-1177405648 Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 5ca58aca3f9d4d8fa9f1c6315db7f54d Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-DeleteServersTestJSON-1177405648-project Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.690457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '3d0ca05e-16d2-4457-8d89-e994e419ab5d'} Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:15:19.691150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. Sep 10 14:15:19.692336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:15:19.693327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] Returning 404 to user: Instance 3d0ca05e-16d2-4457-8d89-e994e419ab5d could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:15:19.696128 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a6575161-e273-4aa1-848d-2f243dbd4f0c tempest-DeleteServersTestJSON-1177405648 tempest-DeleteServersTestJSON-1177405648-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d" status: 404 len: 111 microversion: 2.1 time: 0.053226 Sep 10 14:15:19.699524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 132/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:19 2022] GET /compute/v2.1/servers/3d0ca05e-16d2-4457-8d89-e994e419ab5d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:15:20.099166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:20.100060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:20.107549 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:20.108328 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:20.109045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:20.109868 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:20.110436 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:20.111059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:20.394803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:20.402448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5f16ea71-906c-4f6e-b04f-7667882046a9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.308460 Sep 10 14:15:20.403013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 139/271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:20 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:21.192577 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-276752086", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "networks": [{"uuid": "4a0a6a28-7749-4ba4-bad7-a951639d54f5"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:21.247866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] validate_networks() for [('4a0a6a28-7749-4ba4-bad7-a951639d54f5', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:15:21.427707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:21.429201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:21.436736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:21.437428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:21.438026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:21.439149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:21.440503 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:21.441316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:21.629014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:21.637798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-99899602-46f5-48e3-924a-c799aeba0a17 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.215339 Sep 10 14:15:21.638454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 140/272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:21 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:21.693412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:15:21.693826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:15:21.694292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:15:21.694691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:15:21.695096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:15:21.703727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:21.704488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:21.704667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:21.705811 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:21.706267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:21.706682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:21.730871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Getting quotas for project d14cf31db1244e5d9f5330a55f6dc801. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:15:21.735299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Getting quotas for user bae66efbdf994be2b6f49ba3e5c08ab6 and project d14cf31db1244e5d9f5330a55f6dc801. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:15:21.750788 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:15:21.754249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:15:21.817437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e4c1c1de-3296-4081-9184-79c4246e3e56 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629496 Sep 10 14:15:21.818085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 133/273] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:15:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:15:21.828960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b146ea0d-f153-48d0-8c28-de8c762742d8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:21.830102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b146ea0d-f153-48d0-8c28-de8c762742d8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:21.895541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b146ea0d-f153-48d0-8c28-de8c762742d8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:21.905413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b146ea0d-f153-48d0-8c28-de8c762742d8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1213 microversion: 2.1 time: 0.080125 Sep 10 14:15:21.906367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 141/274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:21 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:22.664049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:22.664878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:22.673724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:22.674879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:22.675642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:22.676600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:22.677371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:22.678013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:22.928831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:22.929620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:22.937120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:22.937712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:22.938212 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:22.940549 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:22.941023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:22.941451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:23.010516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:23.018826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0c915524-6487-434c-88f2-fe7a0caa6613 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1265 microversion: 2.1 time: 0.094496 Sep 10 14:15:23.019404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 142/275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:22 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:23.160138 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:23.168421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-63eb92d3-6f57-448e-b174-05f47d871b0a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.509434 Sep 10 14:15:23.168994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 134/276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:22 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:24.042655 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:24.043532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:24.052735 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:24.053632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:24.054459 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:24.055493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:24.056076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:24.056657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:24.133287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:24.141092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3d32fbde-18d6-4bd0-84dc-53b94ab06220 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1271 microversion: 2.1 time: 0.102808 Sep 10 14:15:24.141665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 143/277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:24 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:24.192385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:24.193862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:24.201298 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:24.201878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:24.203181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:24.205782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:24.207230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:24.207933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:24.215634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:24.456505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:24.464532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a1518b10-d315-40a6-9c07-b8810d12d33f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.277192 Sep 10 14:15:24.465101 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 135/278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:24 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:25.165178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:25.165796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:25.172026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:25.172452 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:25.172888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:25.174982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:25.175516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:25.175965 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:25.300725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-6e867da4-4799-490f-826f-8171b91d0a13 req-a299146d-4f7f-401d-bc9a-285737ed2036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc989ad-f2c4-41bf-9864-6fe83d70a51e", "tag": "26a777e3-c0b8-45d6-96ec-44afb6358454"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:25.312173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-6e867da4-4799-490f-826f-8171b91d0a13 req-a299146d-4f7f-401d-bc9a-285737ed2036 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:25.312926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-6e867da4-4799-490f-826f-8171b91d0a13 req-a299146d-4f7f-401d-bc9a-285737ed2036 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:25.313584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-6e867da4-4799-490f-826f-8171b91d0a13 req-a299146d-4f7f-401d-bc9a-285737ed2036 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:25.330507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-6e867da4-4799-490f-826f-8171b91d0a13 req-a299146d-4f7f-401d-bc9a-285737ed2036 service nova] Creating event network-changed:26a777e3-c0b8-45d6-96ec-44afb6358454 for instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e on hv-cinder-85690 Sep 10 14:15:25.346094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-6e867da4-4799-490f-826f-8171b91d0a13 req-a299146d-4f7f-401d-bc9a-285737ed2036 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049603 Sep 10 14:15:25.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:25.347892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 136/279] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:15:25.358481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-aa41003e-acfa-4ac8-9198-602738a3a08a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.197472 Sep 10 14:15:25.359515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 144/280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:25 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:25.489024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:25.489721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:25.496041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:25.496533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:25.496971 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:25.497661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:25.498143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:25.498571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:25.736695 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:25.746048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5d994e10-b4b9-4769-bf08-fff7042856fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.261173 Sep 10 14:15:25.746673 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 137/281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:25 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:26.381990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:26.382606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:26.384559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:26.390840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:26.391383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:26.392469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:26.393265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:26.393705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:26.394119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:26.528320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:26.536003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3ce8a0e7-43cb-406b-928e-988b7f7420cc tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.158215 Sep 10 14:15:26.536570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 145/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:26 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:26.769039 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:26.769542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:26.775933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:26.776412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:26.776846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:26.777523 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:26.777973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:26.778391 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:26.908809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:26.916417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-460a659f-0c43-4861-8a55-701af5bc6827 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.151874 Sep 10 14:15:26.916972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 138/283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:26 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:27.558367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:27.559012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:27.565677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:27.566162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:27.566624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:27.567307 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:27.567822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:27.568233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:27.697042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:27.705392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-83059b4a-eaa3-417b-b6b0-774ca2d48dd8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.150082 Sep 10 14:15:27.706157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 146/284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:27 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:27.940019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:27.940646 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:27.946976 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:27.947476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:27.947921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:27.948600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:27.949051 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:27.949474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:28.221520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:28.229156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ad7eafba-8031-45e0-9531-bf7362437c9d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.293519 Sep 10 14:15:28.229708 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 139/285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:27 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:28.728720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:28.729315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:28.735898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:28.736393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:28.736811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:28.737503 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:28.737964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:28.738386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:28.868932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:28.877054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-44740887-abed-4218-9060-6bacb11b1d3c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.151692 Sep 10 14:15:28.877822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 147/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:28 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:29.252386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:29.252988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:29.259473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:29.259971 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:29.260403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:29.261086 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:29.261532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:29.261950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:29.420358 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:29.428633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b82e461f-780b-407f-93a9-35e595f4c14b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.180804 Sep 10 14:15:29.429522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 140/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:29 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:29.900184 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:29.900799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:29.906802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:29.907286 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:29.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:29.908568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:29.909020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:29.909442 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:30.041630 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:30.045083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:30.050869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-579ec4ba-def0-4e25-9e73-3077d0419c01 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.154566 Sep 10 14:15:30.051451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 148/288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:29 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:30.452491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:30.453111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:30.459048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:30.459550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:30.459981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:30.460652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:30.461095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:30.461507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:30.591229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:30.599418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b745d695-742c-4100-8d06-8dd446b64b84 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.150918 Sep 10 14:15:30.600011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 141/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:30 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:31.074260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:31.074773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:31.082271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:31.082754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:31.083188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:31.083903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:31.084352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:31.084803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:31.213941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:31.221558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0c500ca3-a8b5-4470-a191-33348c4adcb3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.151324 Sep 10 14:15:31.222115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 149/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:31 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:31.622053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:31.622687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:31.629807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:31.630280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:31.630708 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:31.631378 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:31.631862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:31.632274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:31.719682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:31.743514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:31.761033 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:31.769246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-85dede43-a5c3-43d7-84d3-b1c7bd06bf3a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.151000 Sep 10 14:15:31.769808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 142/291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:31 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:32.244551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:32.245138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:32.246953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:32.253220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:32.253693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:32.254121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:32.254799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:32.255243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:32.255686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:32.390068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:32.398151 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9bfa06f1-bc08-4ffe-a65a-13aea56f5604 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.157506 Sep 10 14:15:32.398711 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 150/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:32 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:32.791874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:32.792486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:32.798942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:32.799421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:32.799883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:32.800561 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:32.801014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:32.801439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:32.932710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:32.941082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e90a6284-234f-4bce-9af2-a3c2d8f2d2fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.153003 Sep 10 14:15:32.941640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 143/293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:32 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:33.421059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:33.421659 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:33.431642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:33.431642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:33.431642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:33.431642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:33.432010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:33.432010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:33.560787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:33.568541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-118657d7-faab-4c52-925d-9385de5a747f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.151347 Sep 10 14:15:33.569104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 151/294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:33 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:33.963766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:33.964405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:33.971698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:33.972182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:33.972616 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:33.973299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:33.973745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:33.974163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:34.100417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:34.108257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-24a374e1-e544-49e5-98a6-49a3c74c8204 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.148420 Sep 10 14:15:34.108811 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 144/295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:33 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:34.591179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:34.591835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:34.598619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:34.599102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:34.599566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:34.600252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:34.600700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:34.601119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:34.728832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:34.737236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0fc12c52-05b5-4fe4-8deb-aa74c8dcdcc0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.149877 Sep 10 14:15:34.737796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 152/296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:34 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:35.130945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:35.131490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:35.137863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:35.138347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:35.138789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:35.139500 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:35.139960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:35.140387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:35.342178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:35.350211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2d8a3ed0-cc18-4d0e-a577-41252d73b0d4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.223227 Sep 10 14:15:35.350769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 145/297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:35 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:35.759702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:35.760317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:35.766178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:35.766662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:35.767097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:35.767813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:35.768269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:35.768693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:35.907301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:35.915485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-15a539a7-abde-4cbe-9752-c15d040c8072 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.159647 Sep 10 14:15:35.916055 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 153/298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:35 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:36.374263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:36.374961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:36.382983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:36.383496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:36.384077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:36.384871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:36.385332 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:36.385752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:36.526738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:36.534897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-87387b8a-a7cb-4e1f-ba4a-6dab9867a7ec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.164847 Sep 10 14:15:36.535466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 146/299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:36 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:36.938014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:36.939119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:36.945027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:36.945504 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:36.945936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:36.946620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:36.947069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:36.947510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:37.074450 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:37.082631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c37074e6-1ff7-4b50-94ea-2eb9ed3636d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.148431 Sep 10 14:15:37.083199 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 154/300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:36 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:37.557961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:37.558666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:37.561031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:37.566278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:37.566778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:37.567200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:37.567907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:37.568358 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:37.568783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:37.710642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:37.718852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fd3dff10-e750-4814-a52d-989665eb70bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.164697 Sep 10 14:15:37.719458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 147/301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:37 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:38.101573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-66665502-3f0a-43aa-8942-5b22d3411761 req-7a181d37-5c9e-44ba-acb3-2b37280e26a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc989ad-f2c4-41bf-9864-6fe83d70a51e", "name": "network-vif-plugged", "status": "completed", "tag": "26a777e3-c0b8-45d6-96ec-44afb6358454"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:38.104834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:38.105450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:38.112637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:38.112873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:38.113485 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:38.114890 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:38.115530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:38.116526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:38.135591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-66665502-3f0a-43aa-8942-5b22d3411761 req-7a181d37-5c9e-44ba-acb3-2b37280e26a0 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:38.136066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-66665502-3f0a-43aa-8942-5b22d3411761 req-7a181d37-5c9e-44ba-acb3-2b37280e26a0 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:38.136660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-66665502-3f0a-43aa-8942-5b22d3411761 req-7a181d37-5c9e-44ba-acb3-2b37280e26a0 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:38.148944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-66665502-3f0a-43aa-8942-5b22d3411761 req-7a181d37-5c9e-44ba-acb3-2b37280e26a0 service nova] Creating event network-vif-plugged:26a777e3-c0b8-45d6-96ec-44afb6358454 for instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e on hv-cinder-85690 Sep 10 14:15:38.154293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-66665502-3f0a-43aa-8942-5b22d3411761 req-7a181d37-5c9e-44ba-acb3-2b37280e26a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057315 Sep 10 14:15:38.154886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 155/302] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:15:38.248881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:38.257292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8548be51-3655-458c-b45d-fe8421a5c76e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.156583 Sep 10 14:15:38.257854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 148/303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:38 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:38.742862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:38.743585 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:38.749666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:38.750140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:38.750567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:38.751962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:38.752533 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:38.752959 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:38.892352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:38.899847 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e391e96c-c4a1-46cf-80e1-aede2468264d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.161152 Sep 10 14:15:38.912289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 156/304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:38 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:39.278733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:39.279358 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:39.286590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:39.287070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:39.287528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:39.288210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:39.288657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:39.289070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:39.424794 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:39.434634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ba3e49ff-402e-440d-8fa3-0d80bf38ed00 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.159398 Sep 10 14:15:39.435509 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 149/305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:39 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:39.922227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:39.922953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:39.929083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:39.929581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:39.930016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:39.930751 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:39.931167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:39.931624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:40.102680 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:40.111170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-823d640e-48b0-42a6-af0d-4bcb66a1046d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.192884 Sep 10 14:15:40.111954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 157/306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:39 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:40.459304 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:40.459977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:40.466637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:40.467150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:40.467624 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:40.468343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:40.468797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:40.469220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:40.610117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:40.618237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0376989c-b10d-43df-939d-26facd92579d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.163144 Sep 10 14:15:40.618797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 150/307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:40 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:41.133176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:41.133812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:41.139856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:41.140341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:41.140777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:41.142012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:41.142641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:41.143173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:41.276834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:41.286889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f9e3d8da-6fac-4607-af78-0132c0ba14e4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1522 microversion: 2.1 time: 0.157442 Sep 10 14:15:41.287557 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 158/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:41 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:41.641352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:41.642685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:41.649714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:41.650191 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:41.650800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:41.651803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:41.652396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:41.652815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:41.821127 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:41.828903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0d9b6c5b-fac8-4443-9c0a-d5d5dcf4484e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1313 microversion: 2.1 time: 0.191728 Sep 10 14:15:41.830948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 151/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:41 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:42.036401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1761ac1-4599-4761-b4ac-f80ae7e166ad", "device": "/dev/sdb"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:42.039327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:42.046062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.046547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.046978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.047698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.049870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.049870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.309665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:42.310663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:42.318083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.319006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.319700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.320508 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.321157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.321781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.351915 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:42.503045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:42.510701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-aaca792b-e35c-4b01-8815-3185dce7a442 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1502 microversion: 2.1 time: 0.205025 Sep 10 14:15:42.511501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 152/310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:42 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:42.532924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:42.533625 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:42.539806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.540316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.541149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.541450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.541910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.542336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.683905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:42.691949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-44e53074-f744-48ad-a847-c3aa79c7e1d3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1515 microversion: 2.1 time: 0.163208 Sep 10 14:15:42.692525 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 153/311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:42 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:42.854549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:42.855462 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:42.867236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.867767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.868279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:42.873219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:42.874068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:42.874653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:43.086499 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1419f97e-608d-48ce-bd4e-4c0858a1d848 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "POST /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.062001 Sep 10 14:15:43.087128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 159/312] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:15:42 2022] POST /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26/os-volume_attachments => generated 194 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:15:43.090679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:43.101857 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5c5d2a2a-86d5-463a-a64d-2b1599882b9a tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1495 microversion: 2.1 time: 0.251357 Sep 10 14:15:43.104424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 154/313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:42 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1495 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:44.529718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:44.532625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:44.541460 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.542041 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.542957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.544098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.544716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.545454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.572593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'flavor' on Instance uuid 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:15:44.585274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:44.585772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:44.598787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.599287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.599776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.600476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.600932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.601355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.654434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:15:44.680075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d5524086-d3f3-48bd-80b9-6b9a57508e2b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/action" status: 200 len: 32 microversion: 2.1 time: 0.155067 Sep 10 14:15:44.680733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 160/314] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:15:44 2022] POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 14:15:44.692768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:44.693406 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:44.699773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.700905 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.701055 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.701649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.702111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.702538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.758511 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-94a6f1c6-9b07-4247-88e4-7154379526e8 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 204 len: 0 microversion: 2.1 time: 0.177379 Sep 10 14:15:44.759673 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 155/315] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:15:44 2022] DELETE /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:15:44.769088 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:44.769815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:44.776293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.776778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.777212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.777907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:44.778432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:44.778860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:44.864271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:44.875181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-45c451fd-2980-4791-9814-963a83444f5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.188070 Sep 10 14:15:44.875768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 161/316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:44 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:44.919339 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:44.928597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-50a51351-f028-4e32-a80c-c1284e067b1e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1501 microversion: 2.1 time: 0.164283 Sep 10 14:15:44.929159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 156/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:44 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:45.899170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:45.899821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:45.906031 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:45.906514 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:45.906950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:45.907666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:45.908826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:45.909249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:45.952482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:45.953004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:45.960262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:45.963413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:45.963413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:45.963413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:45.963413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:45.963783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:46.045809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:46.050103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:46.055373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-589c1ee2-c208-4a53-946c-800dbb3c8add tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.160542 Sep 10 14:15:46.055967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 162/318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:45 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:46.387736 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:46.396242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3f16d3a2-8d3e-4569-9fff-bb41c0d2093d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1501 microversion: 2.1 time: 0.447776 Sep 10 14:15:46.396818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 157/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:45 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1501 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:15:47.080673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:47.081377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:47.089753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:47.090250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:47.090686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:47.092422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:47.092885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:47.093467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:47.309403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:47.318059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-99f792d3-d3ef-42bf-96ac-505ae0997c9f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.243719 Sep 10 14:15:47.318631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:47 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:47.419893 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:47.420509 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:47.428176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:47.429142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:47.429957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:47.430795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:47.431396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:47.431923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:47.511387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:47.521163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b9cafd19-ca6a-418e-afc9-bbc1d27b1e46 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 200 len: 1459 microversion: 2.1 time: 0.105073 Sep 10 14:15:47.522469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 158/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:47 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 1459 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:47.563755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-f507124b-415c-4482-903f-a4a84e033de3 req-de9b7642-6e24-4469-be5b-609ad99b2e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc989ad-f2c4-41bf-9864-6fe83d70a51e", "name": "network-vif-deleted", "tag": "26a777e3-c0b8-45d6-96ec-44afb6358454"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:47.575664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-f507124b-415c-4482-903f-a4a84e033de3 req-de9b7642-6e24-4469-be5b-609ad99b2e73 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:47.576255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-f507124b-415c-4482-903f-a4a84e033de3 req-de9b7642-6e24-4469-be5b-609ad99b2e73 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:47.576636 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-f507124b-415c-4482-903f-a4a84e033de3 req-de9b7642-6e24-4469-be5b-609ad99b2e73 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:47.590335 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-f507124b-415c-4482-903f-a4a84e033de3 req-de9b7642-6e24-4469-be5b-609ad99b2e73 service nova] Creating event network-vif-deleted:26a777e3-c0b8-45d6-96ec-44afb6358454 for instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e on hv-cinder-85690 Sep 10 14:15:47.595099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-f507124b-415c-4482-903f-a4a84e033de3 req-de9b7642-6e24-4469-be5b-609ad99b2e73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Sep 10 14:15:47.596028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 164/322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:15:48.342868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:48.343515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:48.350722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:48.351483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:48.351933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:48.352631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:48.354336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:48.354771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:48.499642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:48.509973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5108d56e-743a-4846-95c7-e69b751c9d5c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.171479 Sep 10 14:15:48.510579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 159/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:48 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:48.545101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:48.545792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: cdc989ad-f2c4-41bf-9864-6fe83d70a51e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:48.552435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:48.552918 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:48.553353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:48.554046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:48.554499 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:48.554924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:48.569080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] HTTP exception thrown: Instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e could not be found. Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Request method failure captured: Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e HTTP/1.1 Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJv3c67S5OA-l57-Aa6oHP5ghQDxn0Vf5gE4gRH0Q0GZe7LXiCCqSe52kLNzo8zIUjgKe_fwy1J3okVR0AH5lJVyhTAXOXcW7vAs6flPTd7vj1cvFT5-TQyNaeV8DjPJ-gvscjqXtvmkH2U-_6CDgp0_tmdT-xHfOb-ohLe-i-0Rj7Y Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: d14cf31db1244e5d9f5330a55f6dc801 Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesActionsTest-152914306 Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:15:48.570713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d14cf31db1244e5d9f5330a55f6dc801", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d14cf31db1244e5d9f5330a55f6dc801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d14cf31db1244e5d9f5330a55f6dc801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d14cf31db1244e5d9f5330a55f6dc801"}]}] Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesActionsTest-152914306 Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: d14cf31db1244e5d9f5330a55f6dc801 Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesActionsTest-152914306 Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesActionsTest-152914306-project Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: bae66efbdf994be2b6f49ba3e5c08ab6 Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesActionsTest-152914306-project Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e could not be found. Sep 10 14:15:48.572300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'cdc989ad-f2c4-41bf-9864-6fe83d70a51e'} Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e could not be found. Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:15:48.573402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e could not be found. Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e could not be found. Sep 10 14:15:48.574836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:15:48.576175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Returning 404 to user: Instance cdc989ad-f2c4-41bf-9864-6fe83d70a51e could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:15:48.576175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-67bc9414-cad5-4c1d-8219-7695fc396027 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e" status: 404 len: 111 microversion: 2.1 time: 0.031785 Sep 10 14:15:48.576175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:48 2022] GET /compute/v2.1/servers/cdc989ad-f2c4-41bf-9864-6fe83d70a51e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:15:48.675803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1794171361", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "networks": [{"uuid": "4a0a6a28-7749-4ba4-bad7-a951639d54f5"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:15:48.730982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] validate_networks() for [('4a0a6a28-7749-4ba4-bad7-a951639d54f5', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:15:49.094259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:15:49.094671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:15:49.095135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:15:49.096209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:15:49.096617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:15:49.105961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:49.106439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:49.106866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:49.107882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:49.108330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:49.108748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:49.125892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Getting quotas for project d14cf31db1244e5d9f5330a55f6dc801. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:15:49.130228 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Getting quotas for user bae66efbdf994be2b6f49ba3e5c08ab6 and project d14cf31db1244e5d9f5330a55f6dc801. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:15:49.141606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:15:49.144107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:15:49.191985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-34f56dc8-9def-4d5e-bae9-2ade494b60a1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520709 Sep 10 14:15:49.192631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 160/325] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:15:49.203858 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-183bd1d6-1f92-4cdb-b494-8b9c857ab5d1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:49.204691 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-183bd1d6-1f92-4cdb-b494-8b9c857ab5d1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:49.264485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-183bd1d6-1f92-4cdb-b494-8b9c857ab5d1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:49.271545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-183bd1d6-1f92-4cdb-b494-8b9c857ab5d1 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1214 microversion: 2.1 time: 0.071621 Sep 10 14:15:49.272401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 166/326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:49 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:49.537447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:49.538161 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:49.545052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:49.545538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:49.545973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:49.546694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:49.547141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:49.547679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:49.683769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:49.693133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-798fb27d-878b-4159-b449-f385470d1031 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.161106 Sep 10 14:15:49.693707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 161/327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:49 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:50.294120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:50.294839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:50.302542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:50.303032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:50.303480 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:50.304201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:50.304657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:50.305077 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:50.371898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:50.379990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5e92b2d2-f0f0-4715-8c7c-3dffd7860a21 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1218 microversion: 2.1 time: 0.089822 Sep 10 14:15:50.380545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 167/328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:50 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:50.718123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:50.718729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:50.725374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:50.725851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:50.726378 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:50.727105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:50.727575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:50.727995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:50.882187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:50.891093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f79058fe-7c29-4deb-b9a2-1ae47d738039 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.176660 Sep 10 14:15:50.891710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 162/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:50 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:51.403017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:51.403640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:51.411134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:51.411641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:51.412075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:51.412760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:51.413213 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:51.413632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:51.480933 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:51.489530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1ca30dba-746e-4c8b-82d1-2257be5ea862 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1266 microversion: 2.1 time: 0.090256 Sep 10 14:15:51.490105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 168/330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:51 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:51.914214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:51.914808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:51.921145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:51.921624 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:51.922264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:51.923110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:51.924144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:51.924810 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:52.075796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:52.080702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-10825eef-9f27-4830-80c6-155d101d7a9b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.169888 Sep 10 14:15:52.081511 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 163/331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:51 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:52.514166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:52.514769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:52.521838 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:52.522315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:52.522755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:52.523428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:52.523894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:52.524308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:52.659391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:52.667265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b1a61ee2-d1ed-4718-a097-693a89fdf43e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.158006 Sep 10 14:15:52.667878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:52 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:53.104912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:53.105728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:53.112561 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:53.113092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:53.113514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:53.114213 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:53.114674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:53.115102 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:53.254801 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:53.262355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-713d10f2-0dd3-4d63-8751-a451d60f12b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.161297 Sep 10 14:15:53.262917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 164/333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:53 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:53.690096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:53.690777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:53.697200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:53.697682 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:53.698118 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:53.698804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:53.699255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:53.699701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:53.825391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:53.833692 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-85a61fc7-6026-401a-a6d0-6ecae832afcf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.147602 Sep 10 14:15:53.834259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 170/334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:53 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:54.285564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:54.286103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:54.292399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:54.292872 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:54.293301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:54.293973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:54.294425 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:54.294841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:54.437111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:54.445406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e844a34f-da70-4cf4-8759-46173fc8d209 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.163799 Sep 10 14:15:54.445957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 165/335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:54 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:54.856823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:54.857467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:54.865467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:54.865956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:54.866394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:54.867089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:54.867578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:54.868009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:54.999795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:55.007548 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c723af46-ffce-4490-9428-87a51a49dc5d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.154593 Sep 10 14:15:55.008113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:54 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:55.467993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:55.468546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:55.475867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:55.476352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:55.476785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:55.477473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:55.477926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:55.478347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:55.607823 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:55.615698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f34be3ae-efe7-4506-964b-7d04df3fb173 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.151590 Sep 10 14:15:55.616256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 166/337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:55 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:56.029965 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:56.030585 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:56.037953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:56.038438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:56.038879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:56.039612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:56.040073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:56.040501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:56.172194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:56.179966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a134220b-a55b-4aa4-932f-d4ca6e456429 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.153914 Sep 10 14:15:56.180521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 172/338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:56 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:56.638198 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:56.638838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:56.645980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:56.646453 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:56.646881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:56.647584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:56.648032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:56.648447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:56.784809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:56.793566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a6fb6c6d-4e5a-4818-a78f-043e1154284a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.159246 Sep 10 14:15:56.794133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 167/339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:56 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:57.202191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:57.202800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:57.205280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=58 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:57.211295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:57.211871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:57.212304 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:57.212987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:57.213438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:57.213857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:57.348716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:57.356374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c527a209-dc1e-4050-b8fe-9d00336b133e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.158015 Sep 10 14:15:57.356942 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 173/340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:57 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:57.817744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:57.818283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:57.824817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:57.825292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:57.825717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:57.826390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:57.826838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:57.827254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:57.831312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:57.961979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:57.969606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a484396a-7529-42b1-8828-980496ca3153 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.156576 Sep 10 14:15:57.970157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 168/341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:57 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:58.377886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:58.378496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:58.385301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:58.385788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:58.386216 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:58.386902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:58.387338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:58.387783 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:58.520004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:58.529411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-13a7633c-a580-4323-9da1-912451b9602f tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.155202 Sep 10 14:15:58.529978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 174/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:58 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:58.993724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:58.994333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:59.000675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:59.001152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:59.001582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:59.002258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:59.002707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:59.003123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:59.117131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:59.132492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:59.138056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:59.140946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3b6d1ae9-80c5-4471-a548-12d244131b93 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.151018 Sep 10 14:15:59.141505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 169/343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:58 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:15:59.553750 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:15:59.554356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:15:59.556271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:15:59.562386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:59.562907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:59.563347 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:59.564080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:15:59.564541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:15:59.565003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:15:59.690531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:15:59.698181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2d260316-7100-4c5c-964a-21a95b66bfd7 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.148829 Sep 10 14:15:59.698760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 175/344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:15:59 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:00.163471 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:00.164165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:00.170958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:00.171558 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:00.172063 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:00.172831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:00.173358 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:00.173852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:00.344868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:00.353004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f4f52b9a-e1b8-47a6-be30-0115deb2fc7a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.193741 Sep 10 14:16:00.353853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 170/345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:00 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:00.720109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:00.721366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:00.728271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:00.728773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:00.729694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:00.730785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:00.731243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:00.731706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:00.900640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-16694a7a-6c20-4da0-aebc-0f6358e6f575 req-fc7ef521-de67-4df3-90ab-7cf5ca417b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43eb017-c00a-437d-bb20-40eb9354ae83", "tag": "0f5c017f-3a5f-483b-9b0e-9f49cd82a23f"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:00.920259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-16694a7a-6c20-4da0-aebc-0f6358e6f575 req-fc7ef521-de67-4df3-90ab-7cf5ca417b2b service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:00.921084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-16694a7a-6c20-4da0-aebc-0f6358e6f575 req-fc7ef521-de67-4df3-90ab-7cf5ca417b2b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:00.921678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-16694a7a-6c20-4da0-aebc-0f6358e6f575 req-fc7ef521-de67-4df3-90ab-7cf5ca417b2b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:00.938470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-16694a7a-6c20-4da0-aebc-0f6358e6f575 req-fc7ef521-de67-4df3-90ab-7cf5ca417b2b service nova] Creating event network-changed:0f5c017f-3a5f-483b-9b0e-9f49cd82a23f for instance d43eb017-c00a-437d-bb20-40eb9354ae83 on hv-cinder-85690 Sep 10 14:16:00.944711 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-16694a7a-6c20-4da0-aebc-0f6358e6f575 req-fc7ef521-de67-4df3-90ab-7cf5ca417b2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050149 Sep 10 14:16:00.949737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:00.958979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c98d5ee2-6af5-4ae5-a21e-91e42edf4a8e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.242913 Sep 10 14:16:00.959212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 171/346] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:16:00.959920 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 176/347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:00 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:01.378405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:01.379103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:01.386263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:01.386754 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:01.387218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:01.387948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:01.388406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:01.388827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:01.525178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:01.533854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a1577b4b-9684-42a2-b756-2909235a05ac tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.159439 Sep 10 14:16:01.534429 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 172/348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:01 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:02.041646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:02.042261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:02.048598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:02.049081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:02.049517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:02.050207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:02.050662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:02.051085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:02.183952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:02.191559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a3e10efb-3ca6-4089-bb9c-fa61563701f9 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.153760 Sep 10 14:16:02.192874 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 177/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:02 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:02.557140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:02.557754 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:02.564414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:02.564902 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:02.565334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:02.566056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:02.566508 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:02.567426 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:02.702724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:02.711571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-965a1e7d-7c37-459f-babe-f3d18314abf7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.158206 Sep 10 14:16:02.712138 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 173/350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:02 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:03.214334 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:03.214941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:03.221321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:03.221796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:03.222225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:03.222899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:03.223930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:03.224553 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:03.353904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:03.362237 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c583e01c-bd3e-4f56-b821-9c195b8bcac0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.151711 Sep 10 14:16:03.362807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 178/351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:03 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:03.734836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:03.735483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:03.742530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:03.743013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:03.743465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:03.744158 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:03.744618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:03.745044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:03.875978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:03.884043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-97d82ff0-d105-40a7-b130-41342fcd3138 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.153533 Sep 10 14:16:03.884594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 174/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:03 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:04.385720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:04.386326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:04.392721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:04.393195 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:04.393622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:04.394300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:04.394742 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:04.395914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:04.526353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:04.533936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8477905b-d97b-4eaa-9cf0-af46d77d3179 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.152077 Sep 10 14:16:04.534501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 179/353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:04 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:04.907578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:04.908185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:04.915005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:04.915506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:04.915939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:04.916619 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:04.917065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:04.917484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:05.048351 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:05.056691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-11d60324-94f7-44ba-a409-c29e8a8e0e6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.153012 Sep 10 14:16:05.057243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 175/354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:04 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:05.557421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:05.558026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:05.564420 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:05.564876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:05.565303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:05.565989 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:05.566422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:05.566839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:05.694640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:05.702168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a4224c1e-e844-4030-9395-fde3763db4c6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.148626 Sep 10 14:16:05.702719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 180/355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:05 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:06.079505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:06.080029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:06.086656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:06.087131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:06.087599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:06.088279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:06.088726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:06.089141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:06.219974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:06.228411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fb752123-d4c7-4992-a457-9f117ba89a8e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.152869 Sep 10 14:16:06.228961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 176/356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:06 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:06.725242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:06.725809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:06.732179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:06.732660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:06.733360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:06.734067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:06.734516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:06.734934 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:06.866001 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:06.869428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:06.874694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0ff4dba6-370e-4106-b128-0fb9e642abc2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.153404 Sep 10 14:16:06.875241 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 181/357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:06 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:07.251300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:07.251966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:07.259297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:07.259807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:07.260236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:07.260914 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:07.261370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:07.261786 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:07.393144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:07.401373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-07e9a9fc-7c1d-4d58-af91-dad04b1ff5fe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.153950 Sep 10 14:16:07.401942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 177/358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:07 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:07.897717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:07.898363 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:07.904890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:07.905379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:07.905815 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:07.906502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:07.906954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:07.907379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:08.044388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:08.052120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bcd49e83-fd51-417a-a83b-f73e86347e2e tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.158419 Sep 10 14:16:08.052753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 182/359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:07 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:08.424486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:08.425108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:08.428500 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:08.434188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:08.434685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:08.435126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:08.435849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:08.436308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:08.436732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:08.570495 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:08.578110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-65f49f1e-e626-456e-8f0b-213dddc9b7cd tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.157576 Sep 10 14:16:08.578665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 178/360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:08 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:09.075101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:09.075733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:09.082022 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:09.082540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:09.083112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:09.083936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:09.084456 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:09.084980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:09.215082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:09.222688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b032fc24-46d6-43da-87eb-aef0135fa4c0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.151372 Sep 10 14:16:09.223248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 183/361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:09 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:09.601368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:09.601973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:09.608721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:09.609200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:09.609638 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:09.610319 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:09.610802 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:09.611222 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:09.742399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:09.750138 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f4a51530-2ccc-4112-baa5-a25bfeb2ed07 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.153122 Sep 10 14:16:09.750691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 179/362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:09 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:10.245467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:10.246083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:10.252808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:10.253299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:10.253767 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:10.254465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:10.254922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:10.255341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:10.389611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:10.397377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e1aa530f-6809-42bb-bd7e-8c5293b6334c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.155738 Sep 10 14:16:10.397937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 184/363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:10 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:10.773187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:10.773827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:10.780261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:10.780749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:10.781183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:10.781859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:10.782308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:10.782734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:10.914193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:10.921799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f6641a90-b3bd-4b14-838a-a8fab023d2ea tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.152599 Sep 10 14:16:10.922360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 180/364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:10 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:11.420211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:11.420846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:11.427839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:11.428344 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:11.428776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:11.429459 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:11.429906 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:11.430322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:11.560508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:11.568324 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c5150c47-8ac6-494d-bf5b-73c65ecfc8f3 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.152027 Sep 10 14:16:11.568880 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 185/365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:11 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:11.944496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:11.945188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:11.951626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:11.952105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:11.952534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:11.953214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:11.953665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:11.954084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:12.081966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:12.090730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-26308086-0793-471d-abe0-3afe91b52d0e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.150080 Sep 10 14:16:12.091316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 181/366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:11 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:12.590675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:12.591279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:12.597843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:12.598480 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:12.599136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:12.599855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:12.600303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:12.600719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:12.734713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:12.743764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-212e915a-6300-4fa0-80f3-e9cd16b3e3bf tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.156852 Sep 10 14:16:12.744524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 186/367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:12 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:13.115785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:13.116332 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:13.123162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:13.123261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:13.123698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:13.124399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:13.124856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:13.125276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:13.265125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:13.272904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-56525fd4-40ba-4599-a3e2-1328bd3998bc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.161910 Sep 10 14:16:13.273484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 182/368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:13 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:13.767671 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:13.768209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:13.774718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:13.775190 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:13.775649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:13.776325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:13.776771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:13.777188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:13.905071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:13.913165 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a67dcca1-40a0-46b2-ae08-8bda4eba7ec2 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.149530 Sep 10 14:16:13.913714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 187/369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:13 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:14.296059 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:14.296768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:14.303381 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:14.303894 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:14.304328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:14.305015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:14.305467 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:14.305888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:14.432663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:14.440507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-736a2fbd-27e5-49f4-926c-969af311d6f6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.148250 Sep 10 14:16:14.440913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 183/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:14 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:14.936610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:14.937245 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:14.944470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:14.944958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:14.945391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:14.946085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:14.946538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:14.947073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:15.077054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:15.085358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5ecb9929-4e12-4f72-b51b-f217f8bd0913 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.152603 Sep 10 14:16:15.085927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 188/371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:14 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:15.462851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:15.463490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:15.469953 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:15.470438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:15.470878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:15.471598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:15.472059 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:15.472484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:15.606029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:15.613995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-68807e26-5fde-4418-83f6-93ad988fc544 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.155172 Sep 10 14:16:15.614549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 184/372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:15 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:16.108942 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:16.109497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:16.115966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:16.116478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:16.116913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:16.117604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:16.118057 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:16.118481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:16.251966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:16.260208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3a02b826-f07d-4a8f-854a-e34a337b0b43 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.155594 Sep 10 14:16:16.260773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 189/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:16 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:16.636626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:16.637234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:16.643876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:16.644366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:16.645418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:16.646175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:16.646630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:16.647055 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:16.666394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:16.781030 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:16.789235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9596fa56-3eb1-4786-86b6-c38c9d827d02 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.156444 Sep 10 14:16:16.789797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 185/374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:16 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:17.282795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:17.283406 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:17.290379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:17.290855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:17.291292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:17.292001 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:17.292445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:17.292859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:17.427512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:17.435421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-37e3ef6e-c9e5-412b-be7b-9fcbda26570d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.156532 Sep 10 14:16:17.436007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 190/375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:17 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:17.816174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:17.817506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:17.824370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:17.824879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:17.825295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:17.826052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:17.826513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:17.827002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:17.983385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:17.992045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-686a4d9d-ef87-4961-a21f-b5284efd2096 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.180792 Sep 10 14:16:17.992636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 186/376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:17 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:18.457916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:18.458555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:18.464951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:18.465433 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:18.465864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:18.466550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:18.467000 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:18.467419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:18.606876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:18.615614 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-845006c5-cd06-4389-8068-92341a570b3b tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.161474 Sep 10 14:16:18.616178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 191/377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:18 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:19.016111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:19.017369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:19.025029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:19.025512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:19.025938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:19.026811 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:19.027266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:19.027740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:19.096911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-6001c45a-ca13-4ecb-979a-ed7c4d013a76 req-67cc54c6-18b7-4cca-a442-c00716268f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43eb017-c00a-437d-bb20-40eb9354ae83", "name": "network-vif-plugged", "status": "completed", "tag": "0f5c017f-3a5f-483b-9b0e-9f49cd82a23f"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:19.122934 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-6001c45a-ca13-4ecb-979a-ed7c4d013a76 req-67cc54c6-18b7-4cca-a442-c00716268f0a service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:19.125029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-6001c45a-ca13-4ecb-979a-ed7c4d013a76 req-67cc54c6-18b7-4cca-a442-c00716268f0a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:19.125736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-6001c45a-ca13-4ecb-979a-ed7c4d013a76 req-67cc54c6-18b7-4cca-a442-c00716268f0a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:19.142943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-6001c45a-ca13-4ecb-979a-ed7c4d013a76 req-67cc54c6-18b7-4cca-a442-c00716268f0a service nova] Creating event network-vif-plugged:0f5c017f-3a5f-483b-9b0e-9f49cd82a23f for instance d43eb017-c00a-437d-bb20-40eb9354ae83 on hv-cinder-85690 Sep 10 14:16:19.149812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-6001c45a-ca13-4ecb-979a-ed7c4d013a76 req-67cc54c6-18b7-4cca-a442-c00716268f0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056587 Sep 10 14:16:19.150747 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 192/378] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:16:19.169777 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:19.178084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e0398d7c-62be-4cfe-8d73-102b1106efb5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.166042 Sep 10 14:16:19.178644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 187/379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:19 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:19.639344 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:19.640068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:19.646054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:19.646534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:19.646978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:19.647688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:19.648143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:19.648561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:19.784444 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:19.792641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cb8f8a16-7878-4f11-9eb3-aa2580dce6ad tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.158387 Sep 10 14:16:19.793197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 193/380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:19 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:20.202125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:20.202732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:20.210152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:20.210633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:20.211064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:20.211779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:20.212235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:20.212656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:20.339611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:20.347140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2ef891c1-33e0-4a6d-91ee-761581ea06ca tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.148890 Sep 10 14:16:20.347734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 188/381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:20 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:20.729421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:20.729899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:20.736455 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:20.736935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:20.737361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:20.738035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:20.738510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:20.739226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:20.815487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:20.816297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:20.823116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:20.823691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:20.824133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:20.824828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:20.825283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:20.825704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:20.865947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lazy-loading 'services' on Instance uuid 6c097854-5050-4604-b9cf-4904586ead26 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:16:20.962082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:20.970399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c4f97e5a-a751-4e08-8d3c-1fd038d1c2f0 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.158618 Sep 10 14:16:20.970982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 189/382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:20 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:20.998146 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4573654e-d5fc-4571-8a90-6892a1041774 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26/os-volume_attachments/d1761ac1-4599-4761-b4ac-f80ae7e166ad" status: 202 len: 0 microversion: 2.1 time: 0.272310 Sep 10 14:16:20.998754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 194/383] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:16:20 2022] DELETE /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26/os-volume_attachments/d1761ac1-4599-4761-b4ac-f80ae7e166ad => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:16:21.370662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:21.371270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:21.377618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:21.378099 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:21.378532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:21.379260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:21.379932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:21.380361 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:21.511186 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:21.518773 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-755aea75-c5c8-409a-859d-43db3f234ae2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.151993 Sep 10 14:16:21.519327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 190/384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:21 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:21.995376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:21.996011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:22.003098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:22.003601 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:22.004056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:22.004737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:22.005179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:22.005594 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:22.136937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:22.145290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6ba2cde4-0ad6-4a29-9e8f-b888f5636964 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.153732 Sep 10 14:16:22.145853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 195/385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:21 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:22.542364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:22.542976 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:22.549397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:22.549876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:22.550311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:22.551111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:22.551615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:22.552042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:22.686317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:22.694305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-10b754f6-8983-4218-a1d0-614732c9f3e0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.155793 Sep 10 14:16:22.694883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 191/386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:22 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:23.167716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:23.168327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:23.174703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:23.175186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:23.175657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:23.176475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:23.176928 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:23.177355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:23.311251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:23.319163 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9c2a0f85-b82e-4350-a6c7-d16beee7a351 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.155303 Sep 10 14:16:23.319752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 196/387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:23 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:23.717127 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:23.717669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:23.724212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:23.724692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:23.725123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:23.725812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:23.726264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:23.726683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:23.853578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:23.861588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0406cb6e-37d3-49e2-8ea0-85d0e28b7c34 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.148173 Sep 10 14:16:23.862706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 192/388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:23 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:24.342926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:24.343551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:24.350645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:24.351131 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:24.351611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:24.352303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:24.352753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:24.353175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:24.499511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:24.507937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0a4a95c2-9cd7-41bd-b6a2-aa159e05700c tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1314 microversion: 2.1 time: 0.168794 Sep 10 14:16:24.508672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 197/389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:24 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:24.886294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:24.886913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:24.893297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:24.893762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:24.894196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:24.895175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:24.895667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:24.896092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:25.032556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:25.041318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-508c013e-b230-4bfd-948e-49402f1ede37 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.158870 Sep 10 14:16:25.041973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 193/390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:24 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:25.531393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:25.532070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:25.539033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:25.539610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:25.540044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:25.540726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:25.541177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:25.541593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:25.560122 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:25.677723 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:25.685741 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-edf84a45-3c4d-4bc8-8ba6-ca5695a30a69 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1496 microversion: 2.1 time: 0.158121 Sep 10 14:16:25.686312 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 198/391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:25 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:26.064549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:26.065166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.072122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.072675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.073046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.074079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.074192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.074644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.254758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:26.263604 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5b659f06-d5aa-42ea-88b5-73a2e6114bbe tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1501 microversion: 2.1 time: 0.202673 Sep 10 14:16:26.264179 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 194/392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:26 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:26.286794 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2897318-1f4f-429a-9b06-5ee71b2e1562"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:26.289382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.295686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.296265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.296925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.297618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.298218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.298645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.302299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:26.302794 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.308977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.309504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.310331 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.311411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.312049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.312799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.324911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] HTTP exception thrown: Cannot 'attach_volume' instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 while it is in vm_state rescued Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Request method failure captured: Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/os-volume_attachments HTTP/1.1 Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 74 Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuenlU242EO7D9nGmkG2doxdtT7aJBj_Zl81ZveG_OE1klgLXgfGbihLt-R8I2sCIMgegEp508v6l6nAAjcinvEzoh6InkSTUTNViKY96J74c27QLyEQITMfBToMi13MUCV8sgc-SEf8IJjYvnYtZLoleQaKt_3VrYS-qWNk7AF7iY Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:16:26.326658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cffd972dec364c89bbc04fd078dc7fd9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}] Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8f96c9a2a49047b5b8abd3b2c1475a18 Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {"volumeAttachment": {"volumeId": "a2897318-1f4f-429a-9b06-5ee71b2e1562"}} Sep 10 14:16:26.328087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Cannot 'attach_volume' instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 while it is in vm_state rescued Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'server_id': '0d1b2a0b-e748-4e8f-aa8b-ea9ded131152', 'body': {'volumeAttachment': {'volumeId': 'a2897318-1f4f-429a-9b06-5ee71b2e1562'}}} Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:16:26.328980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 while it is in vm_state rescued Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:16:26.330102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 while it is in vm_state rescued Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Returning 409 to user: Cannot 'attach_volume' instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 while it is in vm_state rescued {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cf3f09a7-e20d-485d-82f4-2a42e85a854a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045702 Sep 10 14:16:26.331148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 199/393] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:16:26 2022] POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 14:16:26.338315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:26.338992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.341755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:16:26.346428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.347075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.348785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.348957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.349352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.349780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.436137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-79a64c55-35cc-4b75-89fa-e9894bc3b1b9 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/action" status: 202 len: 0 microversion: 2.1 time: 0.099095 Sep 10 14:16:26.437406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7b94878b-1c80-4c05-b930-3daf5633d3d6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 204 len: 0 microversion: 2.1 time: 0.139541 Sep 10 14:16:26.437859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 200/394] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:16:26 2022] POST /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 14:16:26.438917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 195/395] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:16:26 2022] DELETE /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 14:16:26.448265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:26.449252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.454367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:26.455046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.456276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.456891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.458316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.459180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.459777 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.460417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.462252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.463033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.463563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.464277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.464909 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.465339 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.492767 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:16:26.580569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ce814932-269c-499c-8ab9-db1751168f28 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 204 len: 0 microversion: 2.1 time: 0.137267 Sep 10 14:16:26.584183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 201/396] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:16:26 2022] DELETE /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:16:26.589893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:26.590737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.596836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.597318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.598364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.599259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.599736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.600740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.619835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:26.629358 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-77857205-1896-48f6-adf1-bd20e9f95e89 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1509 microversion: 2.1 time: 0.186414 Sep 10 14:16:26.630502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 196/397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:26 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:26.639361 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:26.640005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:26.647153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.647761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.648270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.649035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:26.649581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:26.650079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:26.753447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:26.761643 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-919ed9cd-8829-42cf-a8a5-3e061fd492ca tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1502 microversion: 2.1 time: 0.176201 Sep 10 14:16:26.767864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 202/398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:26 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:26.793376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:26.801887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9ceafdc2-b0ae-4a10-acdb-386ec962fc95 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1514 microversion: 2.1 time: 0.169276 Sep 10 14:16:26.802924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 197/399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:26 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:27.653534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:27.654048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:27.656713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:27.664148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:27.665259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:27.665705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:27.666477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:27.666925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:27.667353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:27.784491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:27.785200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:27.792014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:27.792501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:27.792937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:27.793635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:27.794085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:27.794513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:27.800551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:27.808261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d4bf5483-2d4a-4fe7-af19-781177dd29af tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1509 microversion: 2.1 time: 0.158604 Sep 10 14:16:27.808816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 203/400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:27 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:27.824738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:27.825343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:27.831143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:27.831663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:27.832638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:27.833473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:27.833954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:27.834375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:27.971229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:27.979706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:27.981749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-517d0c62-0682-48bc-a276-0aad8d67e35d tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1502 microversion: 2.1 time: 0.200960 Sep 10 14:16:27.982496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 198/401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:27 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:27.988023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6feae1d9-a49c-42e0-bd41-828f53b07a56 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1514 microversion: 2.1 time: 0.166767 Sep 10 14:16:27.988704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 204/402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:27 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:28.831222 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:28.833165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:28.839779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:28.840260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:28.840693 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:28.841385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:28.841860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:28.842279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:28.977703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:28.985662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6fe6772d-aaca-4bd8-9658-c02ad586d21d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1509 microversion: 2.1 time: 0.158363 Sep 10 14:16:28.986165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 199/403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:28 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:29.008979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:29.009696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:29.010448 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:29.011179 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:29.016937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:29.017527 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:29.018030 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:29.018259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:29.018519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:29.019012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:29.019115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:29.019782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:29.019865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:29.020262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:29.020363 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:29.020678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:29.043224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:29.158896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:29.162021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:29.168146 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2e3d2f35-1389-4a63-9b3a-bc1aac007e34 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1502 microversion: 2.1 time: 0.163270 Sep 10 14:16:29.168724 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 205/404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:29 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:29.171212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8b608d94-43d9-4368-bca6-458ee45094c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1514 microversion: 2.1 time: 0.164518 Sep 10 14:16:29.171959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 200/405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:29 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:30.010069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:30.010705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:30.017035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.017517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.017955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.018630 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.019078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.020038 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.195457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:30.196232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:30.199066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:30.202258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.203527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.204463 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.205361 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.206141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.206768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.207869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2df4b47b-d945-40d0-a43f-7fdba180edc7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1509 microversion: 2.1 time: 0.201172 Sep 10 14:16:30.208591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 206/406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:30 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:30.213278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:30.213895 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:30.220843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.221717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.223558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.228308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.228786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.229265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.393501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:30.402769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-629c0139-7ec7-4ece-81b1-6651e12a6537 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1502 microversion: 2.1 time: 0.214931 Sep 10 14:16:30.403393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 201/407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:30 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:30.426854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:30.435546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b4a915d1-6555-44f5-8c9f-a87c8cde7686 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1514 microversion: 2.1 time: 0.225732 Sep 10 14:16:30.447972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 207/408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:30 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:30.951302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-c19c27c1-5839-4731-9761-6e243f416d84 req-43d2f7c3-3f00-4167-8780-596af652a2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43eb017-c00a-437d-bb20-40eb9354ae83", "name": "network-vif-deleted", "tag": "0f5c017f-3a5f-483b-9b0e-9f49cd82a23f"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:30.961631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-c19c27c1-5839-4731-9761-6e243f416d84 req-43d2f7c3-3f00-4167-8780-596af652a2d1 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:30.962636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-c19c27c1-5839-4731-9761-6e243f416d84 req-43d2f7c3-3f00-4167-8780-596af652a2d1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:30.963240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-c19c27c1-5839-4731-9761-6e243f416d84 req-43d2f7c3-3f00-4167-8780-596af652a2d1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:30.975626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-c19c27c1-5839-4731-9761-6e243f416d84 req-43d2f7c3-3f00-4167-8780-596af652a2d1 service nova] Creating event network-vif-deleted:0f5c017f-3a5f-483b-9b0e-9f49cd82a23f for instance d43eb017-c00a-437d-bb20-40eb9354ae83 on hv-cinder-85690 Sep 10 14:16:30.980285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-c19c27c1-5839-4731-9761-6e243f416d84 req-43d2f7c3-3f00-4167-8780-596af652a2d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Sep 10 14:16:30.980869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 202/409] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:31.194981 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-83f52544-9513-4e81-a9b4-a24b82c2cab5 req-6eac9f5a-b522-44f6-a154-bfd3144ef64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c097854-5050-4604-b9cf-4904586ead26", "name": "network-vif-deleted", "tag": "07cd3df2-b597-494d-ae14-abe706937316"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:31.205097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-83f52544-9513-4e81-a9b4-a24b82c2cab5 req-6eac9f5a-b522-44f6-a154-bfd3144ef64a service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.205571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-83f52544-9513-4e81-a9b4-a24b82c2cab5 req-6eac9f5a-b522-44f6-a154-bfd3144ef64a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.205999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-83f52544-9513-4e81-a9b4-a24b82c2cab5 req-6eac9f5a-b522-44f6-a154-bfd3144ef64a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.229683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-83f52544-9513-4e81-a9b4-a24b82c2cab5 req-6eac9f5a-b522-44f6-a154-bfd3144ef64a service nova] Creating event network-vif-deleted:07cd3df2-b597-494d-ae14-abe706937316 for instance 6c097854-5050-4604-b9cf-4904586ead26 on hv-cinder-85690 Sep 10 14:16:31.234809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:31.236169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:31.238410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-83f52544-9513-4e81-a9b4-a24b82c2cab5 req-6eac9f5a-b522-44f6-a154-bfd3144ef64a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047738 Sep 10 14:16:31.240718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 208/410] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:31.246405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.247400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.248042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.248980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.249592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.250315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.387092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:31.395611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8bd6ca55-53bd-4076-80f7-68196bc627ed tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1509 microversion: 2.1 time: 0.167163 Sep 10 14:16:31.396407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 203/411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:31 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:31.428194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:31.428911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:31.436024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.436797 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.437609 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.438476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.439103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.439559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.459839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:31.460456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:31.466283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.466774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.467208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.467936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.468393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.468814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.474491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:31.475049 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:31.475545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:31.475996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lazy-loading 'fault' on Instance uuid d43eb017-c00a-437d-bb20-40eb9354ae83 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:16:31.528499 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:31.534009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:31.537196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0526cc8e-fc2b-4b49-8075-424d28884698 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1304 microversion: 2.1 time: 0.114615 Sep 10 14:16:31.537972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 209/412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:31 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:31.543903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9ca5cdbc-07cd-4659-b2c5-c1b38c8a99b6 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1472 microversion: 2.1 time: 0.088361 Sep 10 14:16:31.544699 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 204/413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:31 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:32.419669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:32.420269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:32.426714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.427196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.427654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.428341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.428790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.429208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.557645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:32.561393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:32.562028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:32.565922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d77bed4d-7199-480c-9859-78ca4dfe7b5d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1509 microversion: 2.1 time: 0.150086 Sep 10 14:16:32.567365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 210/414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:32 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:32.569401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.569873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.570579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.571265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.571739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.572017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:32.572198 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.572624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:32.578301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.578779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.579224 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.579924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.580372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.580786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.605089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:32.605567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:32.605995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:32.606433 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lazy-loading 'fault' on Instance uuid d43eb017-c00a-437d-bb20-40eb9354ae83 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:16:32.644112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:32.650957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:32.652714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-04c0a088-0210-4008-bdc5-b1df2765713c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1472 microversion: 2.1 time: 0.084146 Sep 10 14:16:32.653311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 211/415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:32 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1472 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:32.658797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9182e95d-c577-428d-be86-42c87889a067 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1304 microversion: 2.1 time: 0.101302 Sep 10 14:16:32.659347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 205/416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:32 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:33.272365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1974563244", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:33.326799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] validate_networks() for None {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:16:33.590078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:33.590694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:33.597153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.597729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.598310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.599001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.599469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.599886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.609790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:16:33.610302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:16:33.610685 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:16:33.611096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:16:33.611564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:16:33.621409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.621896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.622331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.623056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.623545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.623977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.642000 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Getting quotas for project 37278fff738c474d9090d3324f984711. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:16:33.646394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Getting quotas for user ca1929f4d511416a93c784d327691573 and project 37278fff738c474d9090d3324f984711. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:16:33.657935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:16:33.660309 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:16:33.707694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e374f325-3b91-4a0f-8843-42fb632c51cd tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439939 Sep 10 14:16:33.708444 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 212/417] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:16:33.712743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:33.713352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:33.720233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.720724 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.721155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.721849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.722313 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.722786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.739710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:33.747786 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2b2d68a9-90f0-45e3-b46b-e82837ba61b6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1515 microversion: 2.1 time: 0.161478 Sep 10 14:16:33.748580 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 206/418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:33 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:33.753210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:33.754933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:33.755975 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.756454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.756879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.757318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lazy-loading 'fault' on Instance uuid 6c097854-5050-4604-b9cf-4904586ead26 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:16:33.761257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:33.763719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.764450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.765097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.766414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.767131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.767790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.813148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:33.814606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:33.815105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:33.815568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:33.816370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lazy-loading 'fault' on Instance uuid d43eb017-c00a-437d-bb20-40eb9354ae83 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:16:33.823120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d521b8ab-fd1f-45b6-8495-d2747c18644d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1309 microversion: 2.1 time: 0.113857 Sep 10 14:16:33.823924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 213/419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:33 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:33.829138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cfa92f66-ae90-47f8-bc8c-1ceb2c8ab797 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:33.829972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cfa92f66-ae90-47f8-bc8c-1ceb2c8ab797 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:33.874424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae66efbdf994be2b6f49ba3e5c08ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14cf31db1244e5d9f5330a55f6dc801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:33.887132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-afe24c12-f919-4ae7-bc2f-f01e04ed6238 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 200 len: 1304 microversion: 2.1 time: 0.137296 Sep 10 14:16:33.888109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 207/420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:33 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:33.912756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cfa92f66-ae90-47f8-bc8c-1ceb2c8ab797 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:33.921630 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cfa92f66-ae90-47f8-bc8c-1ceb2c8ab797 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1215 microversion: 2.1 time: 0.096031 Sep 10 14:16:33.922333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 214/421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:33 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:34.847366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:34.848936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:34.855533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.856010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.856443 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:34.857129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.857578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.857996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:34.896253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.896744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.897179 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:34.897675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lazy-loading 'fault' on Instance uuid 6c097854-5050-4604-b9cf-4904586ead26 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:16:34.912660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:34.914111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] [instance: d43eb017-c00a-437d-bb20-40eb9354ae83] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:34.924734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.926473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.927149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:34.928249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.928961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.929690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:34.945508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] HTTP exception thrown: Instance d43eb017-c00a-437d-bb20-40eb9354ae83 could not be found. Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Request method failure captured: Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 HTTP/1.1 Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJv3c67S5OA-l57-Aa6oHP5ghQDxn0Vf5gE4gRH0Q0GZe7LXiCCqSe52kLNzo8zIUjgKe_fwy1J3okVR0AH5lJVyhTAXOXcW7vAs6flPTd7vj1cvFT5-TQyNaeV8DjPJ-gvscjqXtvmkH2U-_6CDgp0_tmdT-xHfOb-ohLe-i-0Rj7Y Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: d14cf31db1244e5d9f5330a55f6dc801 Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesActionsTest-152914306 Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:16:34.947809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d14cf31db1244e5d9f5330a55f6dc801", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d14cf31db1244e5d9f5330a55f6dc801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d14cf31db1244e5d9f5330a55f6dc801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d14cf31db1244e5d9f5330a55f6dc801"}]}] Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesActionsTest-152914306 Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: d14cf31db1244e5d9f5330a55f6dc801 Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesActionsTest-152914306 Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesActionsTest-152914306-project Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: bae66efbdf994be2b6f49ba3e5c08ab6 Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesActionsTest-152914306-project Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance d43eb017-c00a-437d-bb20-40eb9354ae83 could not be found. Sep 10 14:16:34.949076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'd43eb017-c00a-437d-bb20-40eb9354ae83'} Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43eb017-c00a-437d-bb20-40eb9354ae83 could not be found. Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:16:34.950203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43eb017-c00a-437d-bb20-40eb9354ae83 could not be found. Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43eb017-c00a-437d-bb20-40eb9354ae83 could not be found. Sep 10 14:16:34.951317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:34.952395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:34.953945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] Returning 404 to user: Instance d43eb017-c00a-437d-bb20-40eb9354ae83 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:16:34.954789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1d8d676c-fb41-46ce-8f84-76c6d62cb8e6 tempest-VolumesActionsTest-152914306 tempest-VolumesActionsTest-152914306-project] 10.222.0.26 "GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83" status: 404 len: 111 microversion: 2.1 time: 0.047282 Sep 10 14:16:34.955630 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 215/422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:34 2022] GET /compute/v2.1/servers/d43eb017-c00a-437d-bb20-40eb9354ae83 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 14:16:34.960786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:34.961633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:34.973530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-233c542f-a6d9-47bf-8a83-6653bbc4daf3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 200 len: 1309 microversion: 2.1 time: 0.129805 Sep 10 14:16:34.974588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 208/423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:34 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:34.975639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.976139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.976577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:34.977321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:34.977775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:34.978198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:35.078869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:35.078869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-581316b8-dcca-473c-a58f-53eedafd2a07 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1267 microversion: 2.1 time: 0.121233 Sep 10 14:16:35.078869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 216/424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:34 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:35.205810 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7447721a-8b25-4fa3-a570-e5aff68e96c4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'create', calling method: .version_select at 0x7ff6b72ff4c0>, body: {"keypair": {"name": "tempest-keypair-1080881406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVUjaGw2JZDPyCsZ/UAf8mBbE1qVzj/8i7IeTg1GFcYYjikc+zfIjd7ceH6fr85tYTQ8x1uFm530sSshll6X4vAKEy8sXv816jSzaZeLSwO5MMjRiVatBOxdWF1euoN1g=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:35.221401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-7447721a-8b25-4fa3-a570-e5aff68e96c4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:16:35.225772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-7447721a-8b25-4fa3-a570-e5aff68e96c4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for user 8f96c9a2a49047b5b8abd3b2c1475a18 and project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:16:35.251366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7447721a-8b25-4fa3-a570-e5aff68e96c4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050882 Sep 10 14:16:35.252003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 209/425] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:16:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:35.999772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:36.000387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: 6c097854-5050-4604-b9cf-4904586ead26] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:36.007693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:36.008205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:36.009225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:36.031318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:36.032208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:36.032569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:36.047638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] HTTP exception thrown: Instance 6c097854-5050-4604-b9cf-4904586ead26 could not be found. Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Request method failure captured: Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 HTTP/1.1 Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJvJc4JKhxjiCojQGJ2zjBnv4xDgH2IP15rML1CZAyd3rrbdYa83snu_CVToLzMUU_SqmYdkbJLeP6E0M3WgyJOd_i16ckonMAF_sNxksdcfixgFQgs8Oq_1dis_tPo9iR-sSKCxHfqKFrctAlv1eC5ABLCQuLNpl28Ul1oThUFG6zQ Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: e3a9c95bc33f4697917a9e8c53f78a98 Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1983160924 Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:16:36.049219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3a9c95bc33f4697917a9e8c53f78a98", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3a9c95bc33f4697917a9e8c53f78a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3a9c95bc33f4697917a9e8c53f78a98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3a9c95bc33f4697917a9e8c53f78a98"}]}] Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesSnapshotTestJSON-1983160924 Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: e3a9c95bc33f4697917a9e8c53f78a98 Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1983160924 Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesSnapshotTestJSON-1983160924-project Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8f468d0b1fec4502858b8e29ac640ebd Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesSnapshotTestJSON-1983160924-project Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 6c097854-5050-4604-b9cf-4904586ead26 could not be found. Sep 10 14:16:36.050622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '6c097854-5050-4604-b9cf-4904586ead26'} Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c097854-5050-4604-b9cf-4904586ead26 could not be found. Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:16:36.051925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c097854-5050-4604-b9cf-4904586ead26 could not be found. Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c097854-5050-4604-b9cf-4904586ead26 could not be found. Sep 10 14:16:36.053082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:16:36.054112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Returning 404 to user: Instance 6c097854-5050-4604-b9cf-4904586ead26 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:16:36.054112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-df0edce0-b2b7-4d96-90f3-dd8b077aeecc tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26" status: 404 len: 111 microversion: 2.1 time: 0.055380 Sep 10 14:16:36.054112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 217/426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:35 2022] GET /compute/v2.1/servers/6c097854-5050-4604-b9cf-4904586ead26 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:16:36.103232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:36.103878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:36.110443 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:36.111875 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:36.112482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:36.113423 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:36.114146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:36.115008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:36.221005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:36.232988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b2aa27f4-56f9-4e42-8b52-819f01fda97b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1273 microversion: 2.1 time: 0.135437 Sep 10 14:16:36.244078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 210/427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:36 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:36.788320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1951783840", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa8a33cb-7e36-4402-b68d-98738d77dd04"}], "security_groups": [{"name": "tempest-securitygroup--1324357746"}], "key_name": "tempest-keypair-1080881406", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:36.906897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] validate_networks() for [('fa8a33cb-7e36-4402-b68d-98738d77dd04', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:16:37.259970 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:37.260510 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:37.266845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:37.267331 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:37.267795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:37.268485 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:37.268938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:37.270249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:37.291192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:16:37.291654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:16:37.292128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:16:37.292539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:16:37.292956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:16:37.301833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:37.302405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:37.302938 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:37.303786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:37.304250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:37.304684 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:37.322479 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:16:37.326319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Getting quotas for user 8f96c9a2a49047b5b8abd3b2c1475a18 and project cffd972dec364c89bbc04fd078dc7fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:16:37.338271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:16:37.340638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:16:37.392004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-27c6fe21-aa17-4c3c-a1c4-9372c3fcb2fa tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.608123 Sep 10 14:16:37.400569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 218/428] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:16:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:16:37.405507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:37.406666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-992dfee3-485b-44d4-b44e-95e2955370ce tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:37.407348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-992dfee3-485b-44d4-b44e-95e2955370ce tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:37.413908 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7b5cf393-dfd2-4cb2-b924-739c5c607809 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.157725 Sep 10 14:16:37.414439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 211/429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:37 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:37.468808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-992dfee3-485b-44d4-b44e-95e2955370ce tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:37.476309 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-992dfee3-485b-44d4-b44e-95e2955370ce tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1246 microversion: 2.1 time: 0.074600 Sep 10 14:16:37.476864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 219/430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:37 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:38.438674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:38.439286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:38.445867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:38.446352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:38.446787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:38.447500 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:38.447959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:38.448381 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:38.498738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:38.499263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:38.506640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:38.507124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:38.507587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:38.508276 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:38.508729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:38.509151 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:38.571433 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:38.579800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-da154623-4a78-4af2-b9e7-fe319e262b91 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1250 microversion: 2.1 time: 0.084875 Sep 10 14:16:38.580370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 220/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:38 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:38.587582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:38.595245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-99b02eca-6047-41c5-8ac1-a32b10566774 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.160394 Sep 10 14:16:38.595826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 212/432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:38 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:39.602643 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:39.603245 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:39.609888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:39.610361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:39.610863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:39.611564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:39.612013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:39.612428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:39.618284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:39.618887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:39.621348 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:39.626517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:39.627001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:39.627435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:39.628151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:39.628606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:39.629292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:39.678145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:39.686206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-25c424f5-3e97-45d1-ad71-54f4fc1503a6 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1250 microversion: 2.1 time: 0.087362 Sep 10 14:16:39.686765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 221/433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:39 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:39.760947 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:39.768604 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7cbd6795-5874-4901-9ff2-101ccdf4385f tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.154264 Sep 10 14:16:39.769162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 213/434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:39 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:40.709094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:40.709715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:40.716324 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:40.716962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:40.717406 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:40.718113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:40.718570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:40.719002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:40.782166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:40.794031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:40.795465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1cb206a5-bb62-413a-9b5a-74067b559bec tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1242 microversion: 2.1 time: 0.089259 Sep 10 14:16:40.797089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:40.807503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:40.808216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:40.808649 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:40.809339 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:40.809787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:40.810204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:40.813778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 222/435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:40 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:41.028536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:41.036910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0e3d7f73-94b7-421d-9ba5-4413ec46f1bb tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.248766 Sep 10 14:16:41.037482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 214/436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:40 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:41.058964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-91388dc7-2f7a-412a-91d2-f0a9497a4835 req-6c8091b0-25df-499c-8128-980d54e37828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbc0d98-3500-4449-9836-4add6ed6def1", "tag": "bf921842-ece6-45ec-88f3-c725a9651153"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:41.068525 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-91388dc7-2f7a-412a-91d2-f0a9497a4835 req-6c8091b0-25df-499c-8128-980d54e37828 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:41.069007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-91388dc7-2f7a-412a-91d2-f0a9497a4835 req-6c8091b0-25df-499c-8128-980d54e37828 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:41.069444 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-91388dc7-2f7a-412a-91d2-f0a9497a4835 req-6c8091b0-25df-499c-8128-980d54e37828 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:41.081629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-91388dc7-2f7a-412a-91d2-f0a9497a4835 req-6c8091b0-25df-499c-8128-980d54e37828 service nova] Creating event network-changed:bf921842-ece6-45ec-88f3-c725a9651153 for instance 6cbc0d98-3500-4449-9836-4add6ed6def1 on hv-cinder-85690 Sep 10 14:16:41.087693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-91388dc7-2f7a-412a-91d2-f0a9497a4835 req-6c8091b0-25df-499c-8128-980d54e37828 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032315 Sep 10 14:16:41.088283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 223/437] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:41.821910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:41.822459 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:41.828859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:41.829349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:41.829787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:41.830483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:41.830941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:41.831366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:41.902285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:41.910021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-33df8b2a-b12a-4c98-9f92-9e0589af6421 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1298 microversion: 2.1 time: 0.092053 Sep 10 14:16:41.910584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 215/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:41 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:42.060980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:42.061682 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:42.069106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:42.069587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:42.070106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:42.070871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:42.071320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:42.071781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:42.204249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:42.211987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9a1a3d42-be19-45b4-a29c-6aa74ab176fc tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.155184 Sep 10 14:16:42.212556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 224/439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:42 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:42.935219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:42.935967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:42.943175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:42.943690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:42.944124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:42.944817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:42.945268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:42.945687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:43.015105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:43.024146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cb46e168-8d95-4ad5-83cb-9a0e9630edb4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1298 microversion: 2.1 time: 0.094768 Sep 10 14:16:43.025094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 216/440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:42 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:43.234781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:43.235386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:43.246670 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:43.247176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:43.247983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:43.249205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:43.250014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:43.250773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:43.385302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:43.392813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bd19fb03-a836-4b08-bd93-4fab223e037d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.162236 Sep 10 14:16:43.393376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 225/441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:43 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:44.048012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:44.048620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:44.055103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:44.055620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:44.056058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:44.056742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:44.057225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:44.057650 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:44.120212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:44.123707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:44.129800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-35197d6f-21c6-46c3-b3c7-291a4fb50c75 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1298 microversion: 2.1 time: 0.085966 Sep 10 14:16:44.130353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 217/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:44 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:44.416027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:44.416803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:44.423038 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:44.423550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:44.423984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:44.424702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:44.425153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:44.426106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:44.599147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:44.606719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f6ced904-c106-423b-8013-721aad8c123c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.194696 Sep 10 14:16:44.607289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 226/443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:44 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:45.152678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:45.153319 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:45.160421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:45.160943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:45.161380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:45.162085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:45.162543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:45.162977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:45.232895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:45.242045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:45.254226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e06d0ce5-f80b-424d-bd28-13639b802fb3 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1298 microversion: 2.1 time: 0.105015 Sep 10 14:16:45.255019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 218/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:45 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:45.632791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:45.633569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:45.646671 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:45.647961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:45.649351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:45.652386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:45.653439 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:45.655215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:45.931299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:45.944888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4f7f9571-d77b-4707-b3ef-328eb1d8230b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.319080 Sep 10 14:16:45.945385 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 227/445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:45 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:46.278198 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:46.278809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:46.285733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:46.286221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:46.286657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:46.287488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:46.287830 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:46.288252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:46.432752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:46.448060 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0eed907c-f325-4839-8dcc-076f88da2a6b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.173649 Sep 10 14:16:46.448724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 219/446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:46 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:46.970671 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:46.973051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:46.981604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:46.982588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:46.983192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:46.984256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:46.984734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:46.985323 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:47.172454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:47.192920 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f931e04c-e1a6-405b-ae61-3f22d6edf0c6 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.225142 Sep 10 14:16:47.193467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 228/447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:46 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:47.206931 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:47.207769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:47.214352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:47.215122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:47.215767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:47.217144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:47.218246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:47.219267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:47.259367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d44fc05d-0eec-40d0-805a-c77cc67c75e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/ips" status: 200 len: 148 microversion: 2.1 time: 0.055607 Sep 10 14:16:47.260672 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 220/448] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:16:47 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/ips => generated 148 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:47.498829 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:47.499538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:47.501602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=4 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:47.502585 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=16 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:47.519036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:47.520078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:47.520509 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:47.526302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:47.526923 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:47.527956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:47.726860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:47.735621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-58f619a6-5704-46c2-9323-f49a08da8ea1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.240735 Sep 10 14:16:47.737178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 229/449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:47 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:48.215767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:48.216380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:48.223686 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:48.224173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:48.224606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:48.225294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:48.225748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:48.226169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:48.354229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:48.362145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a67fa353-c3e9-4e74-ad60-b62b9a441981 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.150287 Sep 10 14:16:48.362697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 221/450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:48 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:48.760460 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:48.761053 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:48.767345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:48.767859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:48.768291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:48.768973 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:48.770106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:48.770558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:48.898475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:48.906327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c1667994-89ce-44af-8eec-b34bd7df3342 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.149864 Sep 10 14:16:48.906904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 230/451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:48 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:49.385392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:49.385993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:49.392299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:49.392779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:49.393206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:49.393882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:49.394594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:49.395096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:49.529197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:49.537122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7e162ba4-5d10-456d-ab31-8910117a5a4c tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.155481 Sep 10 14:16:49.537686 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 222/452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:49 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:49.930264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:49.930871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:49.937211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:49.937688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:49.938117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:49.938799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:49.939246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:49.939693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:50.066820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:50.074345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ac8f3988-7394-4bb7-9772-62df49ccf313 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.147965 Sep 10 14:16:50.074898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 231/453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:49 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:50.560601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:50.561249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:50.568225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:50.568713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:50.569150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:50.569840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:50.570301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:50.570725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:50.697828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:50.705466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-db20a948-777b-4647-af64-8362f0ba7570 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.148719 Sep 10 14:16:50.706032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 223/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:50 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:51.097326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:51.097970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:51.104399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:51.104876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:51.105311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:51.105989 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:51.106437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:51.106850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:51.237684 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:51.246278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f119b3dd-4fc4-4378-9a39-85d78148ca81 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.153104 Sep 10 14:16:51.246828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 232/455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:51 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:51.729353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:51.729887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:51.736572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:51.737054 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:51.737519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:51.738197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:51.738649 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:51.739069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:51.900234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:51.908318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-26326095-4a5b-4f36-b1cc-fa50ae81b7a4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.182840 Sep 10 14:16:51.908892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 224/456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:51 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:52.268962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:52.269597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:52.284681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:52.284681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:52.284681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:52.284681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:52.284990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:52.284990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:52.432298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:52.445082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-13cfe0bc-72c4-4565-90aa-4f5e4a2e5326 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.180109 Sep 10 14:16:52.445719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 233/457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:52 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:52.940345 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:52.941609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:52.949019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:52.949749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:52.950353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:52.951053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:52.951534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:52.954036 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:53.130703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:53.139028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ecdf36ce-d6f1-46cd-9a4b-b4feb7336ab4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.202741 Sep 10 14:16:53.139633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 225/458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:52 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:53.442908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-982515063", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "networks": [{"uuid": "855cd864-d80a-423b-a501-515f11abd589"}]}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:53.452486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:53.469925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:53.471503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:53.482747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:53.483318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:53.484269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:53.485159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:53.485789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:53.486744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:53.506925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] validate_networks() for [('855cd864-d80a-423b-a501-515f11abd589', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:16:53.649554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:53.662519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-be6a457c-336b-4815-bfe0-cdabfe00ac2d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.196487 Sep 10 14:16:53.684308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 226/459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:53 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:54.110694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:16:54.111113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:16:54.111646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:16:54.112064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:16:54.112477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:16:54.130197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.130855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.131142 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.131993 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.132488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.132877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.169087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:54.169694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:54.183216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.185072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.185520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.186226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.186679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.187105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.197628 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Getting quotas for project e3a9c95bc33f4697917a9e8c53f78a98. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:16:54.205042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Getting quotas for user 8f468d0b1fec4502858b8e29ac640ebd and project e3a9c95bc33f4697917a9e8c53f78a98. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:16:54.225715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:16:54.228296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:16:54.310350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f44c6732-13a0-44b7-a4d8-e33b722c569c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876297 Sep 10 14:16:54.311957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 234/460] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:16:54.319235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:54.321943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:54.329032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.329761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.330350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.331189 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.331844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.332412 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.369528 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:54.487845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:54.497979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ddc178a7-ca89-48c5-b897-4943799cc7ae tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.333461 Sep 10 14:16:54.499047 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 227/461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:54 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:54.504813 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8afe0d50-f8b4-4c2a-b289-633372bc1010 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:54.505974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8afe0d50-f8b4-4c2a-b289-633372bc1010 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:54.564065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8afe0d50-f8b4-4c2a-b289-633372bc1010 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:54.571720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8afe0d50-f8b4-4c2a-b289-633372bc1010 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1218 microversion: 2.1 time: 0.071239 Sep 10 14:16:54.573703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 228/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:54 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:54.691896 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:54.693489 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:54.706528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.711000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.712615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.714547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:54.718344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:54.719309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:54.869445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1413cd50-c652-4646-927e-e7f67f7e7b95 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555246 Sep 10 14:16:54.871273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 235/463] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:16:54 2022] POST /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:55.088853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-099bac45-f63f-435f-8d86-d49f965bf25d req-ff51ddde-d1f2-4d7c-81f1-6fca96871da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae4dfd1-21db-43b2-82d4-6810bbec230c", "tag": "9f9f16ce-e5be-47d7-aaea-0c62e3b54548"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:55.111745 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-099bac45-f63f-435f-8d86-d49f965bf25d req-ff51ddde-d1f2-4d7c-81f1-6fca96871da9 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:55.114537 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-099bac45-f63f-435f-8d86-d49f965bf25d req-ff51ddde-d1f2-4d7c-81f1-6fca96871da9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:55.116513 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-099bac45-f63f-435f-8d86-d49f965bf25d req-ff51ddde-d1f2-4d7c-81f1-6fca96871da9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:55.144217 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:55.153400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a77d1a90-324a-4417-a411-4a5ccaa32c54 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.467117 Sep 10 14:16:55.159168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-099bac45-f63f-435f-8d86-d49f965bf25d req-ff51ddde-d1f2-4d7c-81f1-6fca96871da9 service nova] Creating event network-changed:9f9f16ce-e5be-47d7-aaea-0c62e3b54548 for instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c on hv-cinder-85690 Sep 10 14:16:55.162382 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 229/464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:54 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:55.172632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-099bac45-f63f-435f-8d86-d49f965bf25d req-ff51ddde-d1f2-4d7c-81f1-6fca96871da9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088219 Sep 10 14:16:55.175464 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 236/465] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:55.522335 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:55.524554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:55.531021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:55.531537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:55.531982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:55.532911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:55.533566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:55.534400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:55.604445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:55.605273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:55.622571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:55.624227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:55.626791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:55.628520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:55.629170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:55.629707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:55.728896 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:55.737584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-898fc892-cf33-43bd-afd8-983e747264b9 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.219192 Sep 10 14:16:55.752547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 230/466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:55 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:55.798300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:55.814096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2600e422-3779-40fb-bd1f-f1df530c6a44 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1214 microversion: 2.1 time: 0.215135 Sep 10 14:16:55.814668 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 237/467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:55 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:56.188444 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:56.188961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:56.196012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:56.196763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:56.197373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:56.198254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:56.198714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:56.199139 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:56.343270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:56.353937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-72eee169-b860-43b9-8b50-4e6e765ee540 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.169344 Sep 10 14:16:56.354784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 231/468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:56 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:56.763474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:56.764467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:56.774085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:56.774933 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:56.775626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:56.776326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:56.776945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:56.777524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:56.839242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:56.840523 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:56.847093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:56.847631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:56.848071 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:56.849204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:56.849825 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:56.850264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:56.945739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:56.955373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-623912b8-0190-4437-8907-1f863f4b5202 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1270 microversion: 2.1 time: 0.120727 Sep 10 14:16:56.967682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 232/469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:56 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:56.975468 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:56.986284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1124f626-3612-499d-b505-62d99fc2a046 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.225111 Sep 10 14:16:56.986284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 238/470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:56 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:57.381873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:57.382957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:57.389699 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:57.390183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:57.390629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:57.391311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:57.391836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:57.392450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:57.589024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:57.603949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a94f08c5-9139-4a88-9b7a-706610e2545f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.227791 Sep 10 14:16:57.615934 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 233/471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:57 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:57.630291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-641a12a9-f10d-4e9a-a753-1096bcdb64db req-b1af6a8e-4d5a-4c2a-8172-e1b44f36a38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc0d98-3500-4449-9836-4add6ed6def1", "name": "network-vif-plugged", "status": "completed", "tag": "bf921842-ece6-45ec-88f3-c725a9651153"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:16:57.646177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-641a12a9-f10d-4e9a-a753-1096bcdb64db req-b1af6a8e-4d5a-4c2a-8172-e1b44f36a38b service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:57.647388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-641a12a9-f10d-4e9a-a753-1096bcdb64db req-b1af6a8e-4d5a-4c2a-8172-e1b44f36a38b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:57.649158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-641a12a9-f10d-4e9a-a753-1096bcdb64db req-b1af6a8e-4d5a-4c2a-8172-e1b44f36a38b service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:57.684175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-641a12a9-f10d-4e9a-a753-1096bcdb64db req-b1af6a8e-4d5a-4c2a-8172-e1b44f36a38b service nova] Creating event network-vif-plugged:bf921842-ece6-45ec-88f3-c725a9651153 for instance 6cbc0d98-3500-4449-9836-4add6ed6def1 on hv-cinder-85690 Sep 10 14:16:57.689787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-641a12a9-f10d-4e9a-a753-1096bcdb64db req-b1af6a8e-4d5a-4c2a-8172-e1b44f36a38b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064132 Sep 10 14:16:57.690687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 239/472] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:16:57.981612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:57.983411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:57.994017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:57.995077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:57.995977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:57.997115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:57.997628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:57.998235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:58.009053 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:58.009053 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:58.034395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:58.035593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:58.036308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:58.037263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:58.037991 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:58.038575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:58.102238 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:58.113606 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d6f642b3-0789-44d1-a8bf-5ee73c56b8c2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1270 microversion: 2.1 time: 0.137000 Sep 10 14:16:58.115210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 234/473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:57 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:16:58.232814 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:58.242181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7d4a3c43-7105-4eb2-8287-126348903fe5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.238909 Sep 10 14:16:58.242767 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 240/474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:58 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:58.633804 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:58.635224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:58.644732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:58.646217 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:58.647124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:58.648545 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:58.649183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:58.650112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:58.808894 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:58.813219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:16:58.819957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-33f71caa-4323-4893-9395-458cc092276f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.193318 Sep 10 14:16:58.836176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 235/475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:58 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:59.137408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:59.138061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:59.144781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:59.145269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:59.145761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:59.146466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:59.146919 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:59.147335 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:59.231982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:59.241186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9bdd6691-5436-40e3-bc6c-368aff3349bb tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1270 microversion: 2.1 time: 0.107795 Sep 10 14:16:59.241790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 241/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:59 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:59.269042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:59.270258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:59.290036 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:59.290877 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:59.291666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:59.292643 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:59.293289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:59.294501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:59.535886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:16:59.547898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0d856828-c1d5-4d33-9906-2e8964553f55 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.281940 Sep 10 14:16:59.551499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 236/477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:59 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:16:59.844966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:16:59.845605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:16:59.852130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:59.852624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:59.853063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:16:59.853772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:16:59.854230 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:16:59.854651 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:00.128752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:00.146790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1d79b927-ad66-4e13-ad56-a78b055f2e20 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.304198 Sep 10 14:17:00.148806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 242/478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:16:59 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:00.265984 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:00.266615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:00.273032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:00.274239 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:00.274831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:00.275728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:00.276336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:00.276938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:00.368092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:00.377086 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-09cfcae6-858e-4f36-bc42-eb6f1a1c7157 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1278 microversion: 2.1 time: 0.114961 Sep 10 14:17:00.391465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 237/479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:00 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:00.571254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:00.572279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:00.580815 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:00.581735 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:00.582309 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:00.583842 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:00.584413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:00.584976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:00.800463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:00.810243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4baddaba-4f7f-462a-adfa-703881b05318 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.243892 Sep 10 14:17:00.811266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 243/480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:00 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:01.172313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:01.173499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:01.185214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:01.186096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:01.186716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:01.187849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:01.188461 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:01.188975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:01.336875 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:01.345224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7d41dc41-5d5d-4e88-b0cb-94bf1816634a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.178027 Sep 10 14:17:01.354653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 238/481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:01 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:01.403093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:01.403832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:01.413200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:01.413903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:01.415060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:01.416177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:01.416918 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:01.417726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:01.640138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:01.652512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d5aecdb9-70ef-4c10-98c0-ba350635bf2a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1288 microversion: 2.1 time: 0.253345 Sep 10 14:17:01.656032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 244/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:01 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1288 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:01.838524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:01.839270 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:01.848237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:01.851390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:01.852946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:01.854188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:01.855892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:01.859473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:02.093900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:02.104721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f6375c6e-b3d0-43c2-ad70-e904267dee5b tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1315 microversion: 2.1 time: 0.270064 Sep 10 14:17:02.115658 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 239/483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:01 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:02.371646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:02.372520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:02.378799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:02.379279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:02.379797 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:02.381058 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:02.381512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:02.381940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:02.532513 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:02.542390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a8369461-5ccb-4798-9ba0-e22a2d68b64c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.176551 Sep 10 14:17:02.543184 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 245/484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:02 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:02.676674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:02.678198 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:02.685154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:02.685884 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:02.686315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:02.689735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:02.690217 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:02.690648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:02.915687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:02.926375 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ed7d78b1-8558-44e5-adcd-ed52d43aedf2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.251666 Sep 10 14:17:02.940087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 240/485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:02 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:03.136272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:03.138414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:03.145970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.146461 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.146895 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.147737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.148194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.148778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.337712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:03.351096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-aede6912-386a-414e-9128-650ee874a972 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1465 microversion: 2.1 time: 0.221514 Sep 10 14:17:03.351688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 246/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:03 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:03.411609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:03.412662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:03.423258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.424049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.424713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.425661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.426330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.427845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.456310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:17:03.556517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-714232e8-06ff-491f-b23a-86a1dfe6b3ff tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 204 len: 0 microversion: 2.1 time: 0.148916 Sep 10 14:17:03.557280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 241/487] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:17:03 2022] DELETE /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:17:03.565510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:03.566221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:03.573626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:03.574748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:03.576137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.578334 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.579061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.580047 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.587172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.588005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.588587 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.589459 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.589998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.590127 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.590456 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.590568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.818772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:03.824293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:03.827710 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-78133d77-c8e7-41fa-bcec-572403405be5 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1471 microversion: 2.1 time: 0.265152 Sep 10 14:17:03.828570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 247/488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:03 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:03.834497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-3c9d38e0-c661-405e-8ad8-cd8df74a9341 req-2b310b7c-b80e-4031-b517-29b03c110be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0039da4-c141-4835-b727-1ce03c34dad8", "tag": "14c39682-5b24-48cb-8bc7-142a35c1cb9a"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:03.837608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-62907914-7938-4eb6-9aa0-cc4b89baf817 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.268566 Sep 10 14:17:03.838592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 242/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:03 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:03.847275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-3c9d38e0-c661-405e-8ad8-cd8df74a9341 req-2b310b7c-b80e-4031-b517-29b03c110be8 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.847876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-3c9d38e0-c661-405e-8ad8-cd8df74a9341 req-2b310b7c-b80e-4031-b517-29b03c110be8 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.848375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-3c9d38e0-c661-405e-8ad8-cd8df74a9341 req-2b310b7c-b80e-4031-b517-29b03c110be8 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.861126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-3c9d38e0-c661-405e-8ad8-cd8df74a9341 req-2b310b7c-b80e-4031-b517-29b03c110be8 service nova] Creating event network-changed:14c39682-5b24-48cb-8bc7-142a35c1cb9a for instance f0039da4-c141-4835-b727-1ce03c34dad8 on hv-cinder-85690 Sep 10 14:17:03.867211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-3c9d38e0-c661-405e-8ad8-cd8df74a9341 req-2b310b7c-b80e-4031-b517-29b03c110be8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037236 Sep 10 14:17:03.867990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 248/490] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:03.949128 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:03.949777 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:03.956122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.956618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.957053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:03.957746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:03.958258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:03.958693 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:04.115878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:04.124124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ac4489b4-9dd2-4ecb-82a3-e8dc92332486 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.178787 Sep 10 14:17:04.124886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 243/491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:03 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:04.178955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:04.183944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-daba5292-d333-456d-b705-c3d692f366ab req-bad9e37a-3dcd-4bcb-91c4-bd975118b511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae4dfd1-21db-43b2-82d4-6810bbec230c", "name": "network-vif-plugged", "status": "completed", "tag": "9f9f16ce-e5be-47d7-aaea-0c62e3b54548"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:04.197431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-daba5292-d333-456d-b705-c3d692f366ab req-bad9e37a-3dcd-4bcb-91c4-bd975118b511 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:04.197983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-daba5292-d333-456d-b705-c3d692f366ab req-bad9e37a-3dcd-4bcb-91c4-bd975118b511 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:04.198415 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-daba5292-d333-456d-b705-c3d692f366ab req-bad9e37a-3dcd-4bcb-91c4-bd975118b511 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:04.213904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-daba5292-d333-456d-b705-c3d692f366ab req-bad9e37a-3dcd-4bcb-91c4-bd975118b511 service nova] Creating event network-vif-plugged:9f9f16ce-e5be-47d7-aaea-0c62e3b54548 for instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c on hv-cinder-85690 Sep 10 14:17:04.217742 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:04.220744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-daba5292-d333-456d-b705-c3d692f366ab req-bad9e37a-3dcd-4bcb-91c4-bd975118b511 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042170 Sep 10 14:17:04.222257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 249/492] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:04.852457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:04.853923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:04.855924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:04.862538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:04.863395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:04.864387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:04.864938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:04.865258 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:04.865835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:04.866318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:04.866911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:04.880860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:04.881529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:04.882103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:04.882922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:04.883356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:04.883846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:05.042575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:05.050470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ce6cc35c-326d-4141-a843-c1ce1686b31d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.192489 Sep 10 14:17:05.051050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 250/493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:04 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:05.080078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:05.089030 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5eb85460-7f30-47ca-80e3-8ba136a10b76 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1471 microversion: 2.1 time: 0.240780 Sep 10 14:17:05.089852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 244/494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:04 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:05.147921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:05.148554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:05.154979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:05.155518 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:05.155977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:05.157020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:05.157646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:05.158235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:05.303140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:05.311488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5edfecb5-5ec8-4939-b1f0-dfffdc7828b3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.167654 Sep 10 14:17:05.312629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 251/495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:05 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:06.074565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:06.075108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:06.081645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:06.082131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:06.082560 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:06.083542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:06.084173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:06.084828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:06.115399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:06.116188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:06.123026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:06.123543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:06.124227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:06.125145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:06.125606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:06.126109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:06.442059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:06.476810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1d509dea-3e7d-43e8-a805-04f183c8ca59 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1471 microversion: 2.1 time: 0.365771 Sep 10 14:17:06.478467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 252/496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:06 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:06.486662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:06.486932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:06.509524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:06.510037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:06.510472 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:06.511262 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:06.512613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:06.513067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:06.538293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:06.755706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:06.767458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d65694ea-a0fa-4eb0-ab6c-732a2331cbf2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.696860 Sep 10 14:17:06.783408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 245/497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:06 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:07.027092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:07.035714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-23f2e4da-1e46-41aa-ac14-bcd76d9be098 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.556185 Sep 10 14:17:07.036596 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 253/498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:06 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:07.262001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-5762797c-5d4b-4209-9f30-1a3d57b8744d req-3528e801-6b63-49a5-b655-699be4801b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc0d98-3500-4449-9836-4add6ed6def1", "name": "network-vif-deleted", "tag": "bf921842-ece6-45ec-88f3-c725a9651153"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:07.272627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-5762797c-5d4b-4209-9f30-1a3d57b8744d req-3528e801-6b63-49a5-b655-699be4801b43 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:07.273410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-5762797c-5d4b-4209-9f30-1a3d57b8744d req-3528e801-6b63-49a5-b655-699be4801b43 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:07.274001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-5762797c-5d4b-4209-9f30-1a3d57b8744d req-3528e801-6b63-49a5-b655-699be4801b43 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:07.287803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-5762797c-5d4b-4209-9f30-1a3d57b8744d req-3528e801-6b63-49a5-b655-699be4801b43 service nova] Creating event network-vif-deleted:bf921842-ece6-45ec-88f3-c725a9651153 for instance 6cbc0d98-3500-4449-9836-4add6ed6def1 on hv-cinder-85690 Sep 10 14:17:07.298169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-5762797c-5d4b-4209-9f30-1a3d57b8744d req-3528e801-6b63-49a5-b655-699be4801b43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039713 Sep 10 14:17:07.299174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 246/499] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:07.509936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:07.510633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:07.517853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:07.518345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:07.518787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:07.519646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:07.520111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:07.521097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:07.606484 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:07.617707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e4b09d75-c400-451d-a0d7-4073a07b6b0d tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1429 microversion: 2.1 time: 0.112204 Sep 10 14:17:07.618703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 254/500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:07 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:07.790752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:07.791355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:07.797477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:07.797960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:07.798392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:07.799074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:07.799548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:07.799974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:07.936178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:07.944394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0f3bf347-233d-4d24-a459-36c56bfe7548 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.157950 Sep 10 14:17:07.944958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 247/501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:07 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:08.058732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:08.059425 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:08.065362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.065925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.066437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:08.067814 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.068350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.069035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:08.118340 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2d15ba3c-ed22-4318-8a67-b8099dc547de tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: .version_select at 0x7ff6b74bf8b0>, body: {"keypair": {"name": "tempest-keypair-810619547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9kMp+04icP3Sk3N0YdUr3/ObHZjmmzZDLGAa5xKfm2waL6Vg1RD/jgL6PpNyX4DXsnQ+fpxEBANX+DMAYKRsaztJd6/MvSwXEKDrgZRZC7hIW8hYdeCDjgO79opk/Lfw=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:08.134542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-2d15ba3c-ed22-4318-8a67-b8099dc547de tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:17:08.138663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-2d15ba3c-ed22-4318-8a67-b8099dc547de tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:17:08.162347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2d15ba3c-ed22-4318-8a67-b8099dc547de tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048455 Sep 10 14:17:08.162958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 248/502] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:17:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:08.203300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:08.211191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3656ac4f-c0b2-4d75-94a1-163545190fd2 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.156477 Sep 10 14:17:08.211822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 255/503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:08 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:08.642323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:08.643013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:08.649897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.651724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.652475 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:08.653297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.653946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.654626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:08.694384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.694988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.695637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:08.696185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lazy-loading 'fault' on Instance uuid 6cbc0d98-3500-4449-9836-4add6ed6def1 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:17:08.748308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:08.760818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8022fa39-a824-4f4a-b412-91d50a7bdc90 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1305 microversion: 2.1 time: 0.123300 Sep 10 14:17:08.761590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 249/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:08 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:08.968180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:08.969113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:08.977482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.978072 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.978677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:08.979811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:08.980476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:08.981011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:09.127911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:09.141858 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-90ead0df-8d13-49c0-8d31-684edd0a831b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1372 microversion: 2.1 time: 0.177717 Sep 10 14:17:09.147596 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 256/505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:08 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:09.235291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:09.236055 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:09.245967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:09.246455 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:09.246883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:09.247696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:09.248043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:09.248645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:09.481861 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:09.491709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b1baee87-2cd4-4dd3-a3b8-0edd846705b5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.261368 Sep 10 14:17:09.492275 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 250/506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:09 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:09.712345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-155732447", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6130204-567f-432e-9831-4386656cd324"}], "security_groups": [{"name": "tempest-securitygroup--48355764"}], "key_name": "tempest-keypair-810619547", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:09.786442 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:09.787164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:09.790068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:09.795942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:09.796434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:09.796868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:09.797568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:09.798022 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:09.798445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:09.820194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] validate_networks() for [('c6130204-567f-432e-9831-4386656cd324', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:17:09.836427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:09.836917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:09.837379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:09.838020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lazy-loading 'fault' on Instance uuid 6cbc0d98-3500-4449-9836-4add6ed6def1 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:17:09.883312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:09.889215 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:09.896590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1b9300e1-d895-43ab-9019-030777ec8ee4 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1305 microversion: 2.1 time: 0.114834 Sep 10 14:17:09.897163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 251/507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:09 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:10.166070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:10.166605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:10.173448 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.173931 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.174382 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.175058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.175543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.175969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.211542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:17:10.212040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:17:10.212426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:17:10.212834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:17:10.213245 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:17:10.222471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.222951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.223432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.224348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.224798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.225220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.242565 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:17:10.246535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:17:10.258061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:17:10.260528 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:17:10.309198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-568c89fd-6985-416a-a249-2d4419e2efc2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.601685 Sep 10 14:17:10.310013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 257/508] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:17:09 2022] POST /compute/v2.1/servers => generated 400 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:17:10.310850 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:10.320266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-31f37d26-1ddb-4b00-b502-20ba06ee1a65 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1565 microversion: 2.1 time: 0.158424 Sep 10 14:17:10.320842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 252/509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:10 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:10.329222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c04ba525-1884-431e-b105-0751344dde11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:10.330702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c04ba525-1884-431e-b105-0751344dde11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:10.343428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:10.343951 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:10.350010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.350703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.351143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.351875 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.352505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.352938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.389812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c04ba525-1884-431e-b105-0751344dde11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:10.399648 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c04ba525-1884-431e-b105-0751344dde11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1240 microversion: 2.1 time: 0.082724 Sep 10 14:17:10.400232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 258/510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:10 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:10.447724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-78e41ded-baed-423c-a86b-dd4bf8ead757 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108096 Sep 10 14:17:10.455591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 253/511] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:17:10 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:10.516097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:10.517096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:10.524467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.525661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.526623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.527701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.528584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.529221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.778508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:10.787465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9ff3b72d-8812-437b-95b5-a188b0f42676 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.275358 Sep 10 14:17:10.788063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 259/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:10 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:10.921716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:10.922996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:10.930149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.930559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.931000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.931724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.932184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.932611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.968108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:10.968855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:10.969924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:10.969924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lazy-loading 'fault' on Instance uuid 6cbc0d98-3500-4449-9836-4add6ed6def1 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:17:11.048086 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:11.056613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b52c5a39-aab6-49c1-a05a-e30defd21706 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1305 microversion: 2.1 time: 0.139172 Sep 10 14:17:11.057188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 254/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:10 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:11.423110 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:11.423889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:11.427080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:17:11.427256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Sat Sep 10 14:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 (ip 10.222.0.26) !!! Sep 10 14:17:11.434990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:11.435862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:11.436496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:11.437375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:11.437837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:11.438271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:11.469906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-a23f2e4a-8c5d-42fb-bf91-42e0e27303b6 req-3b11e2ef-917b-474f-b0c4-14fe1123f272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae4dfd1-21db-43b2-82d4-6810bbec230c", "tag": "9f9f16ce-e5be-47d7-aaea-0c62e3b54548"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:11.483214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-a23f2e4a-8c5d-42fb-bf91-42e0e27303b6 req-3b11e2ef-917b-474f-b0c4-14fe1123f272 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:11.484219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-a23f2e4a-8c5d-42fb-bf91-42e0e27303b6 req-3b11e2ef-917b-474f-b0c4-14fe1123f272 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:11.485088 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-a23f2e4a-8c5d-42fb-bf91-42e0e27303b6 req-3b11e2ef-917b-474f-b0c4-14fe1123f272 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:11.502959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-a23f2e4a-8c5d-42fb-bf91-42e0e27303b6 req-3b11e2ef-917b-474f-b0c4-14fe1123f272 service nova] Creating event network-changed:9f9f16ce-e5be-47d7-aaea-0c62e3b54548 for instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c on hv-cinder-85690 Sep 10 14:17:11.510460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-a23f2e4a-8c5d-42fb-bf91-42e0e27303b6 req-3b11e2ef-917b-474f-b0c4-14fe1123f272 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043468 Sep 10 14:17:11.511895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 255/514] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:11.514809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:11.522904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-993d6431-31e2-4b59-92d4-b3b4bb930f0d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1244 microversion: 2.1 time: 0.104589 Sep 10 14:17:11.523505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 260/515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:11 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:11.811529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:11.818564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:11.819574 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:11.820136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:11.820644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:11.821447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:11.822145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:11.823024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:11.987960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:11.997678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7ef4f9ac-a8ad-4942-9180-04d85698905c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.190691 Sep 10 14:17:11.998271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 256/516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:11 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:12.079331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:12.080056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:12.086380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:12.086862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:12.087295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:12.088072 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:12.088545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:12.088962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:12.121568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:12.122040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:12.122466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:12.122904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lazy-loading 'fault' on Instance uuid 6cbc0d98-3500-4449-9836-4add6ed6def1 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:17:12.168301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1929f4d511416a93c784d327691573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37278fff738c474d9090d3324f984711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:12.176068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-701c11e2-27c0-41e3-8b05-a5057cd39f48 tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 200 len: 1305 microversion: 2.1 time: 0.100458 Sep 10 14:17:12.177440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 261/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:12 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:12.546844 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:12.547799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:12.555187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:12.555781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:12.556283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:12.557028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:12.557481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:12.557952 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:12.622496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:12.631164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a4410e4a-c8a7-4531-805b-ab29067a718f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1244 microversion: 2.1 time: 0.089119 Sep 10 14:17:12.631770 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 257/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:12 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:13.022801 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:13.023709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:13.030667 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:13.031342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:13.032058 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:13.032947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:13.033743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:13.034390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:13.199983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:13.201220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] [instance: 6cbc0d98-3500-4449-9836-4add6ed6def1] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:13.214424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:13.215776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:13.216469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:13.217433 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:13.218304 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:13.219029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:13.238288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] HTTP exception thrown: Instance 6cbc0d98-3500-4449-9836-4add6ed6def1 could not be found. Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Request method failure captured: Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 HTTP/1.1 Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJw_67kmsysCc2uzUG6H9DvHqyBYv915iU-EJWFqjq60cRRHpuZavTojC7sU_QuYliDABPjlAFIhI9ZLsSPwDjiFcDwe10pHM_JXuX0vM_cJhfBWE4iX9jRQrs18M_a9GBALdPH_nHtavBi-piVjyjyoNwhgtdOHLDepDjyVNI0fgpk Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 37278fff738c474d9090d3324f984711 Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesNegativeTest-1865386405 Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:17:13.240892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37278fff738c474d9090d3324f984711", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37278fff738c474d9090d3324f984711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37278fff738c474d9090d3324f984711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37278fff738c474d9090d3324f984711"}]}] Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesNegativeTest-1865386405 Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 37278fff738c474d9090d3324f984711 Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesNegativeTest-1865386405 Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesNegativeTest-1865386405-project Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: ca1929f4d511416a93c784d327691573 Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesNegativeTest-1865386405-project Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 6cbc0d98-3500-4449-9836-4add6ed6def1 could not be found. Sep 10 14:17:13.242456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '6cbc0d98-3500-4449-9836-4add6ed6def1'} Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc0d98-3500-4449-9836-4add6ed6def1 could not be found. Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:17:13.243357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc0d98-3500-4449-9836-4add6ed6def1 could not be found. Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc0d98-3500-4449-9836-4add6ed6def1 could not be found. Sep 10 14:17:13.244766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:17:13.247010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] Returning 404 to user: Instance 6cbc0d98-3500-4449-9836-4add6ed6def1 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:17:13.248036 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2bb98bc0-5a73-4a56-b50d-2eb44879166e tempest-VolumesNegativeTest-1865386405 tempest-VolumesNegativeTest-1865386405-project] 10.222.0.26 "GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1" status: 404 len: 111 microversion: 2.1 time: 0.052302 Sep 10 14:17:13.248759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 258/519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:13 2022] GET /compute/v2.1/servers/6cbc0d98-3500-4449-9836-4add6ed6def1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:17:13.300236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:13.321583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-31c4ed00-036f-4cea-8e45-d6ac2f62e129 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.303484 Sep 10 14:17:13.322722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 262/520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:13 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:13.654207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:13.654819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:13.662204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:13.662697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:13.663135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:13.664058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:13.664307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:13.664729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:13.729324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:13.737948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-65339db4-c0ad-4bfd-9aac-c4506bf009c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1292 microversion: 2.1 time: 0.087783 Sep 10 14:17:13.738502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 259/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:13 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:14.345969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:14.347660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:14.354742 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:14.355238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:14.355770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:14.356562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:14.357178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:14.357613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:14.575592 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:14.585925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3b8468ce-560e-4992-8dcf-c4e31750a20e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.243662 Sep 10 14:17:14.586951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 263/522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:14 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:14.761437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:14.762822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:14.770859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:14.771657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:14.772285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:14.773384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:14.774035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:14.774647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:14.962876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:14.972084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-63bad1f8-ddcc-42fc-99dd-5ce405303824 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.214321 Sep 10 14:17:14.973458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 260/523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:14 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:15.611982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:15.612582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:15.619400 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:15.620206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:15.620646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:15.621348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:15.621800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:15.622220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:15.743397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-132cfea2-63d1-4208-badd-b77cb220485a req-4eb20569-d720-4c6d-92b9-7157ef61f51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b950a5-ef31-4b7e-997f-eaac009116e4", "tag": "46486132-4830-45f3-b475-3aa79de871fd"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:15.759272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-132cfea2-63d1-4208-badd-b77cb220485a req-4eb20569-d720-4c6d-92b9-7157ef61f51d service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:15.760146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-132cfea2-63d1-4208-badd-b77cb220485a req-4eb20569-d720-4c6d-92b9-7157ef61f51d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:15.760822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-132cfea2-63d1-4208-badd-b77cb220485a req-4eb20569-d720-4c6d-92b9-7157ef61f51d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:15.773494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-132cfea2-63d1-4208-badd-b77cb220485a req-4eb20569-d720-4c6d-92b9-7157ef61f51d service nova] Creating event network-changed:46486132-4830-45f3-b475-3aa79de871fd for instance 64b950a5-ef31-4b7e-997f-eaac009116e4 on hv-cinder-85690 Sep 10 14:17:15.778713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-132cfea2-63d1-4208-badd-b77cb220485a req-4eb20569-d720-4c6d-92b9-7157ef61f51d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039043 Sep 10 14:17:15.779318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 261/524] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:15.830910 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:15.841488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e52a6d4b-deb1-4d2e-b5c3-38b8a31ea1f4 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.233766 Sep 10 14:17:15.842067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 264/525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:15 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:15.997502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:15.998400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:16.004887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:16.005460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:16.005996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:16.006774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:16.007315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:16.007864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:16.176120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:16.184001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5333c53a-5d4e-4592-82e8-8a172825ca3e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.190567 Sep 10 14:17:16.184575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 262/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:15 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:16.378364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-2415d38f-3738-409f-a040-d8658da7571d req-b6db4bde-bfa7-4464-9a1e-cf751a3e53b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0039da4-c141-4835-b727-1ce03c34dad8", "name": "network-vif-plugged", "status": "completed", "tag": "14c39682-5b24-48cb-8bc7-142a35c1cb9a"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:16.389350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-2415d38f-3738-409f-a040-d8658da7571d req-b6db4bde-bfa7-4464-9a1e-cf751a3e53b1 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:16.389903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-2415d38f-3738-409f-a040-d8658da7571d req-b6db4bde-bfa7-4464-9a1e-cf751a3e53b1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:16.391178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-2415d38f-3738-409f-a040-d8658da7571d req-b6db4bde-bfa7-4464-9a1e-cf751a3e53b1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:16.402754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-2415d38f-3738-409f-a040-d8658da7571d req-b6db4bde-bfa7-4464-9a1e-cf751a3e53b1 service nova] Creating event network-vif-plugged:14c39682-5b24-48cb-8bc7-142a35c1cb9a for instance f0039da4-c141-4835-b727-1ce03c34dad8 on hv-cinder-85690 Sep 10 14:17:16.407877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-2415d38f-3738-409f-a040-d8658da7571d req-b6db4bde-bfa7-4464-9a1e-cf751a3e53b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033558 Sep 10 14:17:16.408455 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 265/527] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:16.865918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:16.866529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:16.873092 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:16.873569 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:16.874001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:16.874766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:16.875152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:16.875592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:17.002981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:17.011143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cb310ab7-6d38-440f-82be-3a0e93e759d5 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.149478 Sep 10 14:17:17.011745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 263/528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:16 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:17.208120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:17.209108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:17.215902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:17.216379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:17.216810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:17.217497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:17.217942 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:17.218357 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:17.347473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:17.355336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e51a2ec4-bc21-4b5d-a808-14df85bd249b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.151557 Sep 10 14:17:17.355937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 266/529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:17 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:18.034610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:18.035367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:18.042321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:18.042913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:18.043417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:18.044206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:18.044729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:18.045219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:18.145347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:18.201669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:18.209590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e08166f6-0de5-4b53-93fd-81e093313829 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.178887 Sep 10 14:17:18.210496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 264/530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:18 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:18.378624 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:18.379176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:18.381654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:18.387785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:18.388322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:18.388822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:18.389447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:18.389903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:18.390325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:18.530765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:18.538979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-63636307-4511-4075-9eea-bb3c73de0af4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.164479 Sep 10 14:17:18.539577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 267/531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:18 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:19.233143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:19.234089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:19.241328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:19.242031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:19.242761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:19.243693 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:19.244520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:19.245099 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:19.445786 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:19.453506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cf984ebf-c2df-4a5e-aee8-b35f57a61fc3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.224634 Sep 10 14:17:19.454058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 265/532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:19 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:19.562092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:19.562707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:19.570126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:19.570602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:19.571061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:19.571779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:19.572233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:19.572654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:19.699541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:19.707109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-463599d5-81c1-41d2-b0b0-c4f0f0f0ae37 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.148856 Sep 10 14:17:19.707714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 268/533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:19 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:20.477268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:20.477896 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:20.484636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:20.485127 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:20.485566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:20.486253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:20.486709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:20.487133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:20.527242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:20.527688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:20.529656 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:20.530482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=8 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:20.536250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:20.537291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:20.537730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:20.538584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:20.539043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:20.539486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:20.563627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4513c97b-5ed5-4c03-a300-b674407a28a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/ips" status: 200 len: 152 microversion: 2.20 time: 0.040226 Sep 10 14:17:20.564256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 269/534] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Sep 10 14:17:20 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 14:17:20.619014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:20.626607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4e72ad34-9c2b-435a-9f05-0840c9ec0cb8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.153755 Sep 10 14:17:20.627170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 266/535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:20 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:20.730614 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:20.731357 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:20.738646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:20.739139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:20.739757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:20.740597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:20.741253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:20.741680 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:20.884765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:20.893107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4a53a845-4ce5-4aad-9a7f-ca526c079483 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.166771 Sep 10 14:17:20.893890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 270/536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:20 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:21.649639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:21.650243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:21.656586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:21.657063 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:21.657492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:21.658169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:21.658613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:21.659027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:21.791943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:21.800124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-90b13a6d-c01b-4aa3-a40a-c8f6e65f6e01 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.154729 Sep 10 14:17:21.800690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 267/537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:21 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:21.916798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:21.917410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:21.924481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:21.925032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:21.925467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:21.926263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:21.926600 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:21.927017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:22.053991 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:22.061511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-85f4aa1d-c254-4372-b340-609c3f61ac62 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.148663 Sep 10 14:17:22.062064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 271/538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:21 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:22.822960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:22.823642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:22.830023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:22.830512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:22.830955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:22.831674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:22.832357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:22.832524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:22.964350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:22.972026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1ca79246-b865-481e-9111-bb4f7408d4a3 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.152833 Sep 10 14:17:22.972727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 268/539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:22 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:23.086214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:23.086753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:23.093139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:23.093616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:23.094046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:23.094723 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:23.095170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:23.095617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:23.115157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:23.230711 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:23.238766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-10e73869-d6a0-482b-b9ef-78a8ee1375c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.157958 Sep 10 14:17:23.239326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 272/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:23 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:23.996705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:23.997312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:24.003709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:24.004184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:24.004659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:24.005232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:24.006410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:24.006829 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:24.133416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:24.141068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bdea1518-7f88-48b3-9449-1636ec9a3d50 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.148211 Sep 10 14:17:24.141628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 269/541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:23 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:24.263939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:24.264557 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:24.270937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:24.271492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:24.271938 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:24.272631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:24.273086 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:24.273511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:24.401389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:24.408944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d7067f9c-e46d-4e42-aeb5-38aea2c8820d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.148888 Sep 10 14:17:24.409511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 273/542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:24 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:25.164328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:25.164866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:25.171202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:25.171712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:25.172148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:25.172840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:25.173297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:25.173721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:25.191703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:25.308940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:25.316832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-374bf95d-b7e3-419b-b331-4b28d2930968 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.156457 Sep 10 14:17:25.317389 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 270/543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:25 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:25.432836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:25.433447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:25.440178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:25.440822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:25.441138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:25.441823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:25.442269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:25.442687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:25.574988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:25.582556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cf73de18-1257-4a8a-89e4-220d241f1dd3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.153601 Sep 10 14:17:25.583108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 274/544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:25 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:26.340832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:26.341522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:26.348261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:26.348822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:26.349991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:26.350947 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:26.351507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:26.352003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:26.496573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:26.510364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a591767e-33e8-4f65-a0ed-8be63bf2fd71 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.173618 Sep 10 14:17:26.510940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 271/545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:26 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:26.604263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:26.604878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:26.611665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:26.612209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:26.612724 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:26.613369 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:26.613826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:26.614253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:26.741294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:26.748760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c59d3c64-c071-4f07-9044-666546b8f8d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.148411 Sep 10 14:17:26.749313 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 275/546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:26 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:27.533944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:27.534648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:27.542309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.542793 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.543227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.543945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.544404 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.544826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.677524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:27.686022 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2efd4ebd-a5df-4d6a-a7ee-43145b39f81c tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.155398 Sep 10 14:17:27.686589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 272/547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:27 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:27.690890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:27.691349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:27.697704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.698185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.698619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.699302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.699786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.700214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.722516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lazy-loading 'flavor' on Instance uuid 5c6e701d-06b7-4ca6-a202-2327ce74a974 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:17:27.772053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:27.772879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:27.779329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.779847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.780286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.780977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.781430 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.781853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.918539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:27.918752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-eee17d84-dda6-4341-91ba-e01e59d2b51d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/action" status: 202 len: 0 microversion: 2.20 time: 0.231701 Sep 10 14:17:27.919352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 276/548] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 10 14:17:27 2022] POST /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 14:17:27.926136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b42c00b5-ace7-4cad-b930-62f20587167e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.158837 Sep 10 14:17:27.926720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 273/549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:27 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:27.927668 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:27.928352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:27.934989 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.935493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.936215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:27.936697 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:27.937156 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:27.937583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:28.069253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:28.077368 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:28.078822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:28.080015 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-22156aa2-f018-451b-90ef-50a8756ec28d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.156348 Sep 10 14:17:28.080577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 277/550] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:27 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:28.708599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:28.709291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:28.715688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:28.716166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:28.716595 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:28.717269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:28.717716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:28.718133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:28.848130 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:28.856325 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b5cd2762-b888-4558-b8b5-92f57745bd43 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.151583 Sep 10 14:17:28.856884 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 274/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:28 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:28.948242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:28.948849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:28.955269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:28.955779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:28.956209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:28.956885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:28.957332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:28.957749 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:29.084185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:29.091825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f7bc9ce4-420b-4e65-a06e-783e6c061f40 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.147385 Sep 10 14:17:29.092396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 278/552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:28 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:29.106404 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:29.107007 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:29.113162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:29.113639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:29.114072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:29.114752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:29.115208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:29.115664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:29.241016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:29.249111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:29.250545 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:29.251729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-862d5b1f-aca0-4adc-ba7c-bbeb1b12c5c8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.149112 Sep 10 14:17:29.252285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 275/553] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:29 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:29.881428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:29.882397 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:29.888629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:29.889109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:29.889544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:29.890217 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:29.890665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:29.891084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:30.017799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:30.025584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ae47511c-beb7-42a0-9e2e-883b522f56da tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.148803 Sep 10 14:17:30.026132 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 279/554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:29 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:30.116272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:30.116878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:30.122779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:30.123254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:30.123723 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:30.124399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:30.124849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:30.125268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:30.253633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:30.261332 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a04aa044-d9c9-477d-98ff-79766ff87737 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.149720 Sep 10 14:17:30.261889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 276/555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:30 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:30.276719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:30.277357 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:30.283233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:30.283760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:30.284179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:30.284873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:30.285313 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:30.285734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:30.417176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:30.425196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:30.426642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:30.428567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2a9fb867-b2f4-40c6-99bf-48c540dfa158 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.155767 Sep 10 14:17:30.429115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 280/556] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:30 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:31.047879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:31.048478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:31.054761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:31.055235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:31.055701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:31.056376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:31.056822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:31.057237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:31.283907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:31.284545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:31.291673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:31.292168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:31.292607 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:31.293317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:31.293773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:31.294202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:31.421671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:31.424568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:31.430325 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-684de4b2-0ec9-4eb9-b47c-13b06d3083b8 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1318 microversion: 2.1 time: 0.386202 Sep 10 14:17:31.430993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 277/557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:31 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:31.432999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9b21a332-a623-4033-abfb-fc8e58e9c5a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.152924 Sep 10 14:17:31.433986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 281/558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:31 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:31.453754 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:31.454360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:31.460915 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:31.461396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:31.461829 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:31.462516 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:31.462964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:31.463383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:31.590221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:31.598324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:31.599916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:31.601066 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-986ea289-4698-4644-ae5a-859539ec5212 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.151151 Sep 10 14:17:31.601619 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 278/559] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:31 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:32.332955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-14811259-a542-4db3-a29d-8092f1beb7fe req-ac970eec-dcd5-479c-89f7-e98d458f0519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b950a5-ef31-4b7e-997f-eaac009116e4", "name": "network-vif-plugged", "status": "completed", "tag": "46486132-4830-45f3-b475-3aa79de871fd"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:32.343239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-14811259-a542-4db3-a29d-8092f1beb7fe req-ac970eec-dcd5-479c-89f7-e98d458f0519 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.343780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-14811259-a542-4db3-a29d-8092f1beb7fe req-ac970eec-dcd5-479c-89f7-e98d458f0519 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.344211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-14811259-a542-4db3-a29d-8092f1beb7fe req-ac970eec-dcd5-479c-89f7-e98d458f0519 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.356002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-14811259-a542-4db3-a29d-8092f1beb7fe req-ac970eec-dcd5-479c-89f7-e98d458f0519 service nova] Creating event network-vif-plugged:46486132-4830-45f3-b475-3aa79de871fd for instance 64b950a5-ef31-4b7e-997f-eaac009116e4 on hv-cinder-85690 Sep 10 14:17:32.361333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-14811259-a542-4db3-a29d-8092f1beb7fe req-ac970eec-dcd5-479c-89f7-e98d458f0519 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Sep 10 14:17:32.362264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 282/560] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:32.454123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:32.454760 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:32.456396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:32.456988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:32.461660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.462145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.462574 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.463170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.463291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.463703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.463804 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.464143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.464236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.464835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.465292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.465719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.614271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:32.623030 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-057c4568-4e8e-4755-a78c-aae33729a296 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1507 microversion: 2.1 time: 0.172938 Sep 10 14:17:32.623629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 279/561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:32 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:32.628057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:32.628655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:32.634668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.635147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.635614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.636304 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.636750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.637172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.648375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:32.657417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-751b865d-2694-453e-9886-19ff1155ebcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.205268 Sep 10 14:17:32.658278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 283/562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:32 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:32.664853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fdeb1b6-ffa4-4d56-8bbe-a13804c019c7", "device": "/dev/sdb"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:32.667492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:32.675183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.675710 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.676158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.677855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:32.678196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:32.678629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:32.792732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:32.800974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:32.803265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:32.804483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7951e0e0-0240-4947-82fa-78f3ec8721a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.179947 Sep 10 14:17:32.805039 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 280/563] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:32 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:33.684176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:33.684781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:33.691242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:33.691745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:33.692175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:33.692848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:33.693428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:33.693855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:33.823400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:33.830918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-18c75258-6295-4637-b3c1-070b42770b2d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.150615 Sep 10 14:17:33.831487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 281/564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:33 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:33.836912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:33.837501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:33.842937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:33.843417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:33.843879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:33.844557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:33.845006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:33.845422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:33.981739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:33.990109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:33.991582 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:33.992747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fa3d35bc-3e39-456e-a541-2171d9ca1e54 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.160352 Sep 10 14:17:33.993299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 282/565] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:33 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:34.124515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:34.125010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:34.131609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:34.132098 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:34.132537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:34.133235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:34.133697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:34.134176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:34.157870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7d19ba9a-b904-449f-b78a-d3c87e0ed5f9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/ips" status: 200 len: 145 microversion: 2.1 time: 0.037189 Sep 10 14:17:34.158435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 283/566] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:17:34 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:34.854171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:34.854856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:34.861917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:34.862490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:34.863029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:34.863745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:34.864202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:34.864624 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:35.002144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:35.009921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-59ae9d68-54ab-4aac-ab18-8f7461743ccb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.160143 Sep 10 14:17:35.010480 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 284/567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:34 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:35.034011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:35.034710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:35.040714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:35.041196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:35.041632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:35.042329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:35.042783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:35.043208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:35.186347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:35.195210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:35.196700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:35.197865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-36e40d52-b23e-40d2-ac62-8051e4c22943 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.168235 Sep 10 14:17:35.198417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 285/568] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:35 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:36.036248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:36.036939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:36.043877 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:36.044387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:36.044825 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:36.045508 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:36.045963 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:36.046386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:36.175336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:36.183289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0909d4cb-38d4-4bee-b6c7-82cc62055b6a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.150888 Sep 10 14:17:36.183949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 286/569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:36 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:36.222973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:36.223605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:36.229442 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:36.229920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:36.230352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:36.231048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:36.231527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:36.231944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:36.249612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:36.363753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:36.371834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:36.373314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:36.374409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b0a41812-8e16-4fdc-a718-b0f117544333 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.155253 Sep 10 14:17:36.374957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 287/570] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:36 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:37.205924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:37.206534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:37.213849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:37.214271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:37.214701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:37.215712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:37.216163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:37.216581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:37.345536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:37.354094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-71b127a7-8590-4723-a36b-a5eceed9cf5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.151948 Sep 10 14:17:37.354647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 288/571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:37 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:17:37.399814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:37.400419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:37.406259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:37.406741 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:37.407178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:37.407896 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:37.408352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:37.408778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:37.535316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:37.543671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:37.545123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:37.546310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0cbc0f7b-5d49-4ee7-bb25-9b5f4e7cbe47 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.150303 Sep 10 14:17:37.546862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 289/572] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:37 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:38.117838 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-72926ef1-6172-4764-9254-77fc3342809a tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "POST /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.458266 Sep 10 14:17:38.118400 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 284/573] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:17:32 2022] POST /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8/os-volume_attachments => generated 194 bytes in 5460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:38.376642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:38.377248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:38.384540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:38.385056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:38.385494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:38.386183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:38.386650 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:38.387076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:38.518300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:38.526111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ceecc15b-e63b-4db7-8453-02eda6563a41 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.153401 Sep 10 14:17:38.526674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 290/574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:38 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:38.573732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:38.574457 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:38.581211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:38.581698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:38.582130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:38.582820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:38.583272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:38.583722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:38.717875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:38.726786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:38.728282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:38.729448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-263be423-11ea-4f11-b4d0-d5a64cd07aa1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.160499 Sep 10 14:17:38.730014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 285/575] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:38 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:39.549505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:39.550777 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:39.563576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:39.564259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:39.564731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:39.565463 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:39.565979 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:39.566411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:39.729916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:39.740275 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-75235db5-7018-41ec-8458-7dd835735a2f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1364 microversion: 2.1 time: 0.194835 Sep 10 14:17:39.741599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 291/576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:39 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:39.755266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:39.756114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:39.762431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:39.762916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:39.763351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:39.764066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:39.764520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:39.764945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:39.784397 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:39.900736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:39.908956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:39.910405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:39.911580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-011c804d-838b-4b75-8d72-052af5cccb6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.160433 Sep 10 14:17:39.912138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 286/577] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:39 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:40.422985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6faf7549-9e29-49ac-b7c8-7701b5ee02ff"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:40.425417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:40.427264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=86 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:40.433412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:40.433905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:40.434360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:40.435046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:40.435537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:40.435960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:40.737895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d344d64e-b4e4-4ac0-b13b-e59da448ff74 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318556 Sep 10 14:17:40.742498 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 292/578] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:17:40 2022] POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:17:40.764254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:40.765162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:40.772620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:40.773215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:40.773665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:40.774374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:40.774866 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:40.775295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:40.938319 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:40.939324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:40.946153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:40.946806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:40.947248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:40.948006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:40.948465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:40.948922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:41.003589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:41.013927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-56ee70cc-51be-470f-9f83-2ad594773f7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1554 microversion: 2.1 time: 0.253775 Sep 10 14:17:41.014542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 287/579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:17:40 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:17:41.036877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:41.037569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:41.044206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:41.044944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:41.045388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:41.046096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:41.046551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:41.046978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:41.086849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:41.095283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:41.096768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:41.097938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f97ad0fe-fd49-448e-892f-2aadccd104ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.164414 Sep 10 14:17:41.098495 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 293/580] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:40 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:41.154891 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-59a1a578-5990-4dd9-acfc-47c74a87affc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121848 Sep 10 14:17:41.155555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 288/581] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:17:41 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:42.101455 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-4e080de8-3e2b-4f00-8109-fc3fa25dd985 req-93843471-a8ca-43d1-8000-260e5d9fbf3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b950a5-ef31-4b7e-997f-eaac009116e4", "tag": "46486132-4830-45f3-b475-3aa79de871fd"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:17:42.112001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-4e080de8-3e2b-4f00-8109-fc3fa25dd985 req-93843471-a8ca-43d1-8000-260e5d9fbf3f service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:42.112481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-4e080de8-3e2b-4f00-8109-fc3fa25dd985 req-93843471-a8ca-43d1-8000-260e5d9fbf3f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:42.112907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-4e080de8-3e2b-4f00-8109-fc3fa25dd985 req-93843471-a8ca-43d1-8000-260e5d9fbf3f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:42.126663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:42.127213 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-4e080de8-3e2b-4f00-8109-fc3fa25dd985 req-93843471-a8ca-43d1-8000-260e5d9fbf3f service nova] Creating event network-changed:46486132-4830-45f3-b475-3aa79de871fd for instance 64b950a5-ef31-4b7e-997f-eaac009116e4 on hv-cinder-85690 Sep 10 14:17:42.128084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:42.132147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-4e080de8-3e2b-4f00-8109-fc3fa25dd985 req-93843471-a8ca-43d1-8000-260e5d9fbf3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Sep 10 14:17:42.133201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 294/582] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:17:42.139232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:42.139762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:42.140204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:42.140920 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:42.141377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:42.141809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:42.378956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:42.390007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:42.392136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:42.393875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bad40e49-a323-4419-a6e1-8ce16990d222 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.273226 Sep 10 14:17:42.407845 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 289/583] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:42 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:43.421568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:43.422290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:43.429248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:43.429743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:43.430175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:43.430864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:43.431311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:43.431758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:43.571235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:43.579994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:43.581660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:43.582985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-28b03e52-79da-4297-91f7-438f14d439a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.166241 Sep 10 14:17:43.583610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 295/584] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:43 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:44.610386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:44.611233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:44.619515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:44.620230 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:44.620899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:44.621718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:44.622238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:44.622817 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:44.772304 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:44.782099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:44.783720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:44.785149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-55a611b7-a4f4-4fbe-b34a-9d0ee97031a4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.179669 Sep 10 14:17:44.786038 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 290/585] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:44 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:45.813674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:45.814195 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:45.820902 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:45.821379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:45.821806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:45.822483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:45.822929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:45.823346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:45.964313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:45.972537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:45.973968 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:45.975117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-70f8aa29-3c88-4448-aeed-569b8a121623 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.165513 Sep 10 14:17:45.975876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 296/586] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:45 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:47.001175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:47.001812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:47.009152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:47.009640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:47.010078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:47.010764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:47.011220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:47.011683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:47.145935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:47.158103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:47.159570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:47.160723 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-90f49fc2-d112-4409-b81c-4b03d866a459 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.163615 Sep 10 14:17:47.161287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 291/587] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:46 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:48.188872 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:48.189482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:48.196761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:48.197245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:48.197682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:48.198367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:48.198822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:48.199245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:48.335634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:48.343942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:48.345401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:48.346540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b4f5fe6e-fc75-4bf1-8477-68568e092331 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.161591 Sep 10 14:17:48.347091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 297/588] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:48 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:49.371356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:49.371997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:49.374340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=50 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:17:49.379606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:49.380094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:49.380556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:49.381395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:49.381851 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:49.382273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:49.513532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:49.522079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:49.523756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:49.524980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-05907057-5cd6-4faa-a895-8388cd46b0e5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.157383 Sep 10 14:17:49.525483 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 292/589] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:49 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:50.551087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:50.551721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:50.558840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:50.559314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:50.559782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:50.560458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:50.560905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:50.561579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:50.690403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:50.699065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:50.700531 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:50.701691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-49b5cace-a391-484c-9cf2-8bb0a8c4ae02 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.154577 Sep 10 14:17:50.702252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 298/590] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:50 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:51.727877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:51.728491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:51.735234 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:51.735765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:51.736200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:51.736884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:51.737345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:51.737794 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:51.864803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:51.872949 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:51.874401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:51.875922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-635b4dfd-07b6-47b0-b396-91477a858b7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.152244 Sep 10 14:17:51.876157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 293/591] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:51 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:17:52.902195 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:52.902828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:52.909611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:52.910128 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:52.910562 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:52.911249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:52.911726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:52.912724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:53.044880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:53.053637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:53.055176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:53.056379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c5637f63-96c1-4875-bfcf-7d4a6cf70fc9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.158094 Sep 10 14:17:53.056937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 299/592] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:52 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:54.082112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:54.082736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:54.089460 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:54.089954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:54.090394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:54.091089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:54.091602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:54.092003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:54.246523 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:54.255340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:54.257728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:54.258662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-064d8a12-09a5-447d-b375-bb39e61f5a88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.180515 Sep 10 14:17:54.259198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 294/593] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:54 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:55.284709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:55.285247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:55.292433 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:55.292922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:55.293355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:55.294052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:55.294503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:55.294921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:55.426278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:55.436882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:55.438301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:55.439492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-56e193f7-ed67-4799-a1ae-9aa94e308eee tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.158859 Sep 10 14:17:55.440047 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 300/594] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:55 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:56.466306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:56.466911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:56.473267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:56.473744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:56.474169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:56.475137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:56.475668 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:56.476090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:56.604943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:56.613205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:56.614629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:56.615855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1d487f54-6862-478d-88eb-8ac622ebb135 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.153405 Sep 10 14:17:56.616405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 295/595] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:56 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:57.641644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:57.642169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:57.649290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:57.649775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:57.650211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:57.650929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:57.651379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:57.651827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:57.783239 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:57.792017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:57.793462 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:57.794597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2c469ba8-1b86-49f7-8d4e-1b916e7a53ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.156973 Sep 10 14:17:57.795141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 301/596] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:57 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:17:58.827716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:17:58.828356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:17:58.834644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:58.835127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:58.835593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:58.836290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:17:58.836737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:17:58.837152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:17:58.965034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:58.972950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:58.975035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:17:58.976382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-39f00828-0dc6-4ba6-8e55-3b7f971882bf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.152543 Sep 10 14:17:58.976938 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 296/597] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:58 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:00.002054 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:00.002690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:00.009753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:00.010230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:00.010663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:00.011344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:00.011822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:00.012267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:00.142418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:00.150823 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:00.152369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:00.153521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7793b686-b052-4778-b690-cfd03b1fbcda tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.155407 Sep 10 14:18:00.154070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 302/598] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:17:59 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:01.034717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d07069df-9dfe-4649-8e29-a363bbd73a4f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:01.041384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d07069df-9dfe-4649-8e29-a363bbd73a4f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:01.041865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d07069df-9dfe-4649-8e29-a363bbd73a4f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:01.042298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d07069df-9dfe-4649-8e29-a363bbd73a4f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:01.103361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d07069df-9dfe-4649-8e29-a363bbd73a4f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Going to try to stop instance {{(pid=120616) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 14:18:01.144871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d07069df-9dfe-4649-8e29-a363bbd73a4f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action" status: 202 len: 0 microversion: 2.1 time: 0.113831 Sep 10 14:18:01.145470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 297/599] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:18:01 2022] POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:18:01.154353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:01.155049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:01.161573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:01.162254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:01.162620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:01.163314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:01.163798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:01.164219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:01.180578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:01.181192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:01.182588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:01.187626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:01.188102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:01.188531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:01.189256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:01.189773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:01.190371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:01.298953 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:01.307872 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-11f7174d-b011-424a-baeb-e4e55330df35 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.157230 Sep 10 14:18:01.308452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 303/600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:01 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:18:01.329555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:01.337689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:01.339118 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:01.340290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2eb0310d-fa38-4d74-bdcb-a425536c1c22 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.164201 Sep 10 14:18:01.340835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 298/601] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:01 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:02.333323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:02.334055 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:02.340610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:02.341100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:02.341534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:02.342226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:02.342679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:02.343126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:02.367094 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:02.367959 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:02.374087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:02.374564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:02.374997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:02.375892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:02.376342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:02.384170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:02.489164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:02.498601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-42233914-580b-4ee5-9281-d112916a6bd4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.169033 Sep 10 14:18:02.499584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 304/602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:02 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:02.533986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:02.542712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:02.544179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:02.545328 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-64f42d5b-87e1-4b48-a748-4d99002c25b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.182896 Sep 10 14:18:02.545885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 299/603] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:02 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:03.523253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:03.523876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:03.530252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:03.530728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:03.531155 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:03.531869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:03.532316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:03.532731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:03.571497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:03.572116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:03.578467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:03.578952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:03.579386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:03.580119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:03.580571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:03.580994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:03.663502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:03.672210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3303a9ed-3f3e-4c7a-9468-8e666cd4a22b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.152992 Sep 10 14:18:03.672797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 305/604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:03 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:03.718043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:03.727361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:03.728862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:03.730140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f5d5f09f-0cef-4c92-989a-a77a1e01e1de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.162532 Sep 10 14:18:03.730700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 300/605] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:03 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:04.465838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-dfd2738e-236f-4257-ad67-da2b14b07544 req-565bf584-6d11-4e15-88dd-e0910efabbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "name": "network-vif-plugged", "status": "completed", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:04.476347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dfd2738e-236f-4257-ad67-da2b14b07544 req-565bf584-6d11-4e15-88dd-e0910efabbcf service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.477071 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dfd2738e-236f-4257-ad67-da2b14b07544 req-565bf584-6d11-4e15-88dd-e0910efabbcf service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.477589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dfd2738e-236f-4257-ad67-da2b14b07544 req-565bf584-6d11-4e15-88dd-e0910efabbcf service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.489518 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-dfd2738e-236f-4257-ad67-da2b14b07544 req-565bf584-6d11-4e15-88dd-e0910efabbcf service nova] Creating event network-vif-plugged:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:18:04.496068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-dfd2738e-236f-4257-ad67-da2b14b07544 req-565bf584-6d11-4e15-88dd-e0910efabbcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Sep 10 14:18:04.496722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 306/606] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:18:04.696032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:04.696670 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:04.703207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.703724 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.704166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.704863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.705320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.705751 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.757569 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:04.758372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:04.764593 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.765086 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.765524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.766214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.766670 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.767090 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.839879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:04.848021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-14f1ec83-b308-4e97-8147-2be149c3c2f5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.155975 Sep 10 14:18:04.848834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 301/607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:04 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:04.854429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:04.854917 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:04.860976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.861454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.861912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.862606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:04.863057 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:04.863482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:04.883511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:04.906166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:04.914868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:04.916349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:04.917518 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8f8ccf9d-b659-4d7c-9ef1-ef64e33666b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.164769 Sep 10 14:18:04.918082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 307/608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:04 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:04.949458 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lazy-loading 'services' on Instance uuid f0039da4-c141-4835-b727-1ce03c34dad8 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:18:05.022117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f61427f6-d510-4fa2-8ed9-db64a38f12ac tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8/os-volume_attachments/2fdeb1b6-ffa4-4d56-8bbe-a13804c019c7" status: 202 len: 0 microversion: 2.1 time: 0.172293 Sep 10 14:18:05.023183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 302/609] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:18:04 2022] DELETE /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8/os-volume_attachments/2fdeb1b6-ffa4-4d56-8bbe-a13804c019c7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:18:05.871992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:05.872607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:05.879692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:05.880265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:05.880864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:05.881877 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:05.882413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:05.882838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:05.943731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:05.945187 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:05.952836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:05.953328 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:05.953760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:05.954451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:05.955081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:05.955527 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:06.028502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:06.036720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-90fea0ff-f663-43c3-ae3a-62e4ba1a8779 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.168547 Sep 10 14:18:06.037282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 308/610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:05 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:06.092157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:06.100089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:06.102519 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:06.103728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-02a2862a-9f65-438d-9430-541c28ad92ca tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.164624 Sep 10 14:18:06.104316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 303/611] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:05 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:07.060627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:07.061317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:07.067707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.068188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.068618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.070053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.070542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.070961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.130765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:07.132579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:07.140029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.140516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.140960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.141680 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.142135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.142555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.217396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:07.217396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3d592fd2-2e91-41db-9ee4-f26ae8f61ab6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.159827 Sep 10 14:18:07.217396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 309/612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:07 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:07.225788 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:07.226293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:07.232045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.232539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.232974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.233668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.234125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.234814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.261159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:18:07.294306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:07.304285 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:07.306040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:07.307200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bff9cdaf-cd00-433c-859e-c250d550f72f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.180503 Sep 10 14:18:07.307918 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 304/613] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:07 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:07.344548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-847923b7-9015-443c-865d-5cc85d9d339b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 204 len: 0 microversion: 2.1 time: 0.122208 Sep 10 14:18:07.345233 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 310/614] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:18:07 2022] DELETE /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 14:18:07.354925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:07.355687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:07.362180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.362666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.363103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.363860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:07.364316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:07.364739 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:07.494987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:07.502757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-eeea007a-66fd-4b81-9064-3706b926e304 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1513 microversion: 2.1 time: 0.153297 Sep 10 14:18:07.503331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 305/615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:07 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:08.241074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:08.241785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:08.248445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:08.248935 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:08.249368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:08.250057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:08.250513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:08.250936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:08.333602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:08.334213 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:08.341628 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:08.342112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:08.342543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:08.343226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:08.343721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:08.344140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:08.387295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:08.395550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0cfed4ec-eee7-468a-99c2-0e0b82948a7a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.158708 Sep 10 14:18:08.396121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 311/616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:08 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:08.478860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:08.487204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:08.488695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:08.489831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f8c83986-b89a-479d-a717-99602b5ff46c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1745 microversion: 2.20 time: 0.160229 Sep 10 14:18:08.490372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 306/617] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:08 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:08.526698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:08.527243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:08.533150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:08.533640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:08.534075 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:08.534762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:08.535219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:08.535671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:08.666476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:08.674132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1999d99b-a3ca-4631-b6fb-919a0067293d tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1513 microversion: 2.1 time: 0.151999 Sep 10 14:18:08.674695 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 312/618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:08 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:09.419127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:09.420155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:09.426599 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:09.427181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:09.427734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:09.428434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:09.428960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:09.429417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:09.521993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:09.523832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:09.530487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:09.530991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:09.531750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:09.532608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:09.533064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:09.533487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:09.563729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:09.573384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-fe43229f-c600-4abb-9033-eb76c8368271 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.158029 Sep 10 14:18:09.573958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 307/619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:09 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:09.668483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:09.677176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:09.679182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:09.680515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-493a3527-6cfe-4c46-8df5-00103dcb36d0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.162669 Sep 10 14:18:09.681107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 313/620] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:09 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:09.697030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:09.697640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:09.703646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:09.704135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:09.704569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:09.705254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:09.705708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:09.706126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:09.836731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:09.844921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-befdbff0-3ab5-47b3-bddb-1dcc1186861b tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1513 microversion: 2.1 time: 0.152482 Sep 10 14:18:09.845489 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 308/621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:09 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:18:10.456803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-ed04b8ea-abbb-4cf2-a926-368ab20d32dd req-35e5226f-4e69-4283-9858-85a71f53cd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0039da4-c141-4835-b727-1ce03c34dad8", "name": "network-vif-deleted", "tag": "14c39682-5b24-48cb-8bc7-142a35c1cb9a"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:10.469350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:10.480490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ed04b8ea-abbb-4cf2-a926-368ab20d32dd req-35e5226f-4e69-4283-9858-85a71f53cd79 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.480973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ed04b8ea-abbb-4cf2-a926-368ab20d32dd req-35e5226f-4e69-4283-9858-85a71f53cd79 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.481954 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ed04b8ea-abbb-4cf2-a926-368ab20d32dd req-35e5226f-4e69-4283-9858-85a71f53cd79 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.499576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-ed04b8ea-abbb-4cf2-a926-368ab20d32dd req-35e5226f-4e69-4283-9858-85a71f53cd79 service nova] Creating event network-vif-deleted:14c39682-5b24-48cb-8bc7-142a35c1cb9a for instance f0039da4-c141-4835-b727-1ce03c34dad8 on hv-cinder-85690 Sep 10 14:18:10.505249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-ed04b8ea-abbb-4cf2-a926-368ab20d32dd req-35e5226f-4e69-4283-9858-85a71f53cd79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061648 Sep 10 14:18:10.505843 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 314/622] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:18:10.597802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:10.599342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:10.607425 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.608074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.609083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.610221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.610838 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.611420 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.707346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:10.708670 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:10.723527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.724025 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.724465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.725175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.725687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.726106 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.780303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:10.790556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cdfcfa15-0ce2-4b36-bdf0-bfebbce93ede tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.196486 Sep 10 14:18:10.794104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 309/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:10 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:10.871041 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:10.872410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:10.879881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.880640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.881339 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.882589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.883244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.883893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.938560 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:10.939398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:10.940097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:10.940771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lazy-loading 'fault' on Instance uuid f0039da4-c141-4835-b727-1ce03c34dad8 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:18:10.950131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:10.961077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:10.963320 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:10.964766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6853600b-c5bc-48f2-9ebc-a03d33068549 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.262334 Sep 10 14:18:10.989846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 315/624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:10 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:10.994383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f468d0b1fec4502858b8e29ac640ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a9c95bc33f4697917a9e8c53f78a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:11.003384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6eeeee89-b144-4620-be4b-ba7fc3e6e03e tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 200 len: 1308 microversion: 2.1 time: 0.136042 Sep 10 14:18:11.004423 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 310/625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:10 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:11.818289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:11.819256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:11.825973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:11.826457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:11.827031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:11.827607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:11.828063 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:11.828476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:11.973706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:11.983744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-14f9212c-efeb-4401-b3b2-f5bda0438fa8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.169279 Sep 10 14:18:11.993867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 316/626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:11 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:12.004236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:12.005074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:12.012913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:12.014595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:12.015501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:12.016573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:12.017108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:12.017554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:12.028329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:12.029296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] [instance: f0039da4-c141-4835-b727-1ce03c34dad8] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:12.035821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:12.036634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:12.037290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:12.038167 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:12.038762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:12.039264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:12.054985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] HTTP exception thrown: Instance f0039da4-c141-4835-b727-1ce03c34dad8 could not be found. Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Request method failure captured: Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 HTTP/1.1 Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJvJc4JKhxjiCojQGJ2zjBnv4xDgH2IP15rML1CZAyd3rrbdYa83snu_CVToLzMUU_SqmYdkbJLeP6E0M3WgyJOd_i16ckonMAF_sNxksdcfixgFQgs8Oq_1dis_tPo9iR-sSKCxHfqKFrctAlv1eC5ABLCQuLNpl28Ul1oThUFG6zQ Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: e3a9c95bc33f4697917a9e8c53f78a98 Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1983160924 Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:18:12.057417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3a9c95bc33f4697917a9e8c53f78a98", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3a9c95bc33f4697917a9e8c53f78a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3a9c95bc33f4697917a9e8c53f78a98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3a9c95bc33f4697917a9e8c53f78a98"}]}] Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesSnapshotTestJSON-1983160924 Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: e3a9c95bc33f4697917a9e8c53f78a98 Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1983160924 Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesSnapshotTestJSON-1983160924-project Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 8f468d0b1fec4502858b8e29ac640ebd Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesSnapshotTestJSON-1983160924-project Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance f0039da4-c141-4835-b727-1ce03c34dad8 could not be found. Sep 10 14:18:12.059028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': 'f0039da4-c141-4835-b727-1ce03c34dad8'} Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0039da4-c141-4835-b727-1ce03c34dad8 could not be found. Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:18:12.059944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0039da4-c141-4835-b727-1ce03c34dad8 could not be found. Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0039da4-c141-4835-b727-1ce03c34dad8 could not be found. Sep 10 14:18:12.061305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:18:12.062635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] Returning 404 to user: Instance f0039da4-c141-4835-b727-1ce03c34dad8 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:18:12.063619 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6ff3ad3a-9d18-45fd-bca0-ad195eb01285 tempest-VolumesSnapshotTestJSON-1983160924 tempest-VolumesSnapshotTestJSON-1983160924-project] 10.222.0.26 "GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8" status: 404 len: 111 microversion: 2.1 time: 0.040499 Sep 10 14:18:12.067881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 317/627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:12 2022] GET /compute/v2.1/servers/f0039da4-c141-4835-b727-1ce03c34dad8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:18:12.184271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:12.192912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:12.195801 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:12.197250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d6b582fe-9602-49de-9d5a-e31d356c314b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.198336 Sep 10 14:18:12.198027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 311/628] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:11 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:13.011366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:13.012032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:13.018530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:13.019021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:13.019490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:13.020183 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:13.020833 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:13.021383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:13.189839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:13.199705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c1a37a8f-f2ec-48ce-99d3-c3db3d4eafbb tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.193379 Sep 10 14:18:13.200297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 318/629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:13 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:13.228175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:13.229476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:13.236182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:13.236742 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:13.237241 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:13.237958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:13.238574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:13.238994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:13.420482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:13.428805 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:13.433173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:13.434672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f959b4de-63dd-4c89-932f-4a7e1d8b5431 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.211026 Sep 10 14:18:13.435601 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 312/630] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:13 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:14.224653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:14.226390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:14.233852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:14.234908 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:14.235335 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:14.236220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:14.236974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:14.237586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:14.386729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:14.395527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bd46a2e2-c97d-41a6-8c4e-49fc16012c47 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.174700 Sep 10 14:18:14.396097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 319/631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:14 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:14.460701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:14.461966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:14.469176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:14.469952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:14.470487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:14.471096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:14.471586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:14.472222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:14.613946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:14.622248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:14.624580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:14.625764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ff4c4981-bb52-4f5c-a389-e5c7dd6551b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.169579 Sep 10 14:18:14.626831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 313/632] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:14 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:15.420662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:15.421273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:15.429396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:15.430313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:15.430918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:15.431818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:15.432478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:15.433120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:15.454195 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:15.585778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:15.595725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a3aff66c-4509-4ef3-9d3b-3922ad6c1b4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.178858 Sep 10 14:18:15.596535 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 320/633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:15 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:15.654043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:15.654798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:15.662367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:15.662896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:15.663325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:15.668036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:15.668723 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:15.669356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:15.848333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:15.857731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:15.859183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:15.860779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-703e7bf3-ef0d-4ae5-b917-a155019e4911 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.211557 Sep 10 14:18:15.871934 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 314/634] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:15 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:16.621573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:16.623262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:16.630396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:16.630892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:16.631330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:16.632958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:16.633570 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:16.633999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:16.777149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:16.786234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5e39f2f8-e379-4252-bac0-7eb127b535d9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.168986 Sep 10 14:18:16.786826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 321/635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:16 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:16.888306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:16.889695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:16.897021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:16.897650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:16.898195 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:16.899194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:16.899789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:16.900464 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:17.041046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:17.049377 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:17.050826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:17.052023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7a77d793-e612-4d1b-9973-b6929856f88d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.167671 Sep 10 14:18:17.053102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 315/636] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:16 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:17.812518 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:17.813067 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:17.820510 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:17.820998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:17.821434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:17.822347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:17.822997 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:17.823427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:18.010728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:18.021932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5fd343b9-c78a-4d92-87ab-dd1185e8c39e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1723 microversion: 2.1 time: 0.214296 Sep 10 14:18:18.022924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 322/637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:17 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:18.083127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:18.083673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:18.090384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:18.090812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:18.091254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:18.091966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:18.092598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:18.093174 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:18.254096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:18.264814 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:18.275821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:18.277530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4bf152d4-1715-4156-b151-b726a6ac1460 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.200503 Sep 10 14:18:18.285834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 316/638] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:18 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:19.047759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:19.049187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:19.057602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.058189 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.058728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.059532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.059978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.060404 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.246639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:19.257806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c6b53b9a-1a07-4d3f-8272-5d1cfc40c9ff tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1700 microversion: 2.1 time: 0.214696 Sep 10 14:18:19.258692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 323/639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:19 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1700 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:19.284108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ab7337ad-ba3d-4395-ac6e-9d2da5369f63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:19.289071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab7337ad-ba3d-4395-ac6e-9d2da5369f63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.289556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab7337ad-ba3d-4395-ac6e-9d2da5369f63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.289994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab7337ad-ba3d-4395-ac6e-9d2da5369f63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.309858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:19.310479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:19.319982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.320493 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.320938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.321743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.322091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.322516 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.356708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ab7337ad-ba3d-4395-ac6e-9d2da5369f63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Going to try to start instance {{(pid=120616) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 14:18:19.392748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:19.431642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ab7337ad-ba3d-4395-ac6e-9d2da5369f63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action" status: 202 len: 0 microversion: 2.1 time: 0.152587 Sep 10 14:18:19.434158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 317/640] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:18:19 2022] POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:18:19.451066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:19.451893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:19.454902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=54 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:19.460546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.461465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.462137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.462974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:19.463435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:19.463904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:19.551037 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:19.560747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:19.562169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:19.565930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a30af446-4c0f-4397-b085-0bf44c85e89c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.261067 Sep 10 14:18:19.579466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 324/641] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:19 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:19.658854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:19.672701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e704f971-1d37-41ca-9f30-884f9bb17679 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1709 microversion: 2.1 time: 0.223201 Sep 10 14:18:19.673631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 318/642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:19 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:18:20.593408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:20.594053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:20.601628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:20.602116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:20.602558 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:20.603285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:20.603769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:20.604231 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:20.696983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:20.697522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:20.703939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:20.704419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:20.704846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:20.705533 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:20.705980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:20.706399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:20.744758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:20.752787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:20.754218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:20.755371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c3da1ea9-a5ca-4a13-977c-819370706582 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1740 microversion: 2.20 time: 0.165914 Sep 10 14:18:20.755948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 325/643] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:20 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:20.838849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:20.847871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c5774fc3-af48-4856-94d8-ead788a92b75 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1709 microversion: 2.1 time: 0.155284 Sep 10 14:18:20.848437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 319/644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:20 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:18:21.781815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:21.782420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:21.789414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:21.789904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:21.790371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:21.791065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:21.791546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:21.791976 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:21.874183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:21.874825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:21.890922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:21.891725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:21.892701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:21.893915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:21.895123 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:21.895920 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:21.961916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:21.971739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:21.973195 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:21.974374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-847f366a-8ba0-433c-b38c-5c0de9c9b00e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1722 microversion: 2.20 time: 0.196498 Sep 10 14:18:21.974932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 326/645] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:21 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:22.039185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:22.047306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5d3d8526-20b1-45e8-a270-4078726c6a4b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1713 microversion: 2.1 time: 0.179659 Sep 10 14:18:22.047892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 320/646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:18:21 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1713 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:18:23.001858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:23.002460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:23.009910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:23.010392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:23.010826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:23.011537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:23.011991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:23.012413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:23.145623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:23.153924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:23.155343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:23.156513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c220c388-66e8-491f-8fea-fdb2e61998a8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1722 microversion: 2.20 time: 0.158488 Sep 10 14:18:23.157060 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 327/647] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:22 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:24.181837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:24.182454 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:24.188826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:24.189314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:24.189749 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:24.190437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:24.190894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:24.191317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:24.317182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:24.325935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:24.327376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:24.328573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-744cff0c-e9b4-49f1-9925-12678a558f38 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1722 microversion: 2.20 time: 0.150754 Sep 10 14:18:24.329135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 321/648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:24 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:25.354597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:25.355472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:25.362201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:25.362679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:25.363107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:25.363821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:25.364272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:25.364690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:25.496776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:25.504753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:25.506182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:25.508017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3ceb6c50-b1dc-4075-bd22-4cf4d1a22dbe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1722 microversion: 2.20 time: 0.156635 Sep 10 14:18:25.508837 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 328/649] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:25 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:26.533884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:26.534497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:26.540981 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:26.541467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:26.541901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:26.542593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:26.543043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:26.543488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:26.580913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-90977982-58c9-441b-a06b-4c06ec4d77c3 req-8fe8dec9-b256-4ef2-8b31-eaf3a3c03c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "name": "network-vif-unplugged", "status": "completed", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:26.591502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-90977982-58c9-441b-a06b-4c06ec4d77c3 req-8fe8dec9-b256-4ef2-8b31-eaf3a3c03c3f service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:26.591988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-90977982-58c9-441b-a06b-4c06ec4d77c3 req-8fe8dec9-b256-4ef2-8b31-eaf3a3c03c3f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:26.592412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-90977982-58c9-441b-a06b-4c06ec4d77c3 req-8fe8dec9-b256-4ef2-8b31-eaf3a3c03c3f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:26.603886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-90977982-58c9-441b-a06b-4c06ec4d77c3 req-8fe8dec9-b256-4ef2-8b31-eaf3a3c03c3f service nova] Creating event network-vif-unplugged:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:18:26.608911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-90977982-58c9-441b-a06b-4c06ec4d77c3 req-8fe8dec9-b256-4ef2-8b31-eaf3a3c03c3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031552 Sep 10 14:18:26.609506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 329/650] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:18:26.681969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:26.690169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:26.691573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:26.692729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4f75e8e4-b403-49f7-9905-c0494f1a9a06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1722 microversion: 2.20 time: 0.162858 Sep 10 14:18:26.693282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 322/651] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:26 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:27.719051 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:27.719770 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:27.725827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:27.727241 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:27.727747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:27.728433 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:27.728885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:27.729309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:27.858891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:27.867375 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:27.868858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:27.870019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b2a0b81a-5b20-4de8-a006-54ba7c5064b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1722 microversion: 2.20 time: 0.155723 Sep 10 14:18:27.870583 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 330/652] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:27 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:28.895508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:28.896121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:28.903112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:28.903631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:28.904071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:28.904751 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:28.905203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:28.905626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.040819 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:29.048948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:29.050536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:29.051646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9021383f-e45c-42b7-b8c8-1c01b448d413 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1725 microversion: 2.20 time: 0.160055 Sep 10 14:18:29.052180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 323/653] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:28 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:29.078333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6dd7e44-d8bb-47a4-a84c-db5cf41630de"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:29.080864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:29.087581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:29.088070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:29.088697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.089430 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:29.089888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:29.090321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.370640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-abe6e379-e154-498b-bc8e-92ac8b658ff7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296164 Sep 10 14:18:29.371519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 331/654] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Sep 10 14:18:29 2022] POST /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:18:29.504538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:18:29.505246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:29.513669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:29.514153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:29.514858 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.515464 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:29.515996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:29.516512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.565235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120616) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 14:18:29.657016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-51835338-bf61-471a-878e-2e0b34b98366 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/action" status: 202 len: 0 microversion: 2.20 time: 0.156559 Sep 10 14:18:29.657800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 324/655] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 10 14:18:29 2022] POST /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:18:29.666939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:29.667240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:29.674452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:29.674935 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:29.675560 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.676554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:29.677261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:29.677927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:29.822705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:29.831147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:29.832616 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:29.833766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a4aa3aa9-1340-4908-a8e6-c1017e659be4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1751 microversion: 2.20 time: 0.171966 Sep 10 14:18:29.834326 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 332/656] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:29 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:30.860869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:30.861832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:30.869224 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:30.869833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:30.870520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:30.871409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:30.873600 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:30.874271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:31.009293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:31.018050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:31.019397 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:31.020594 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-35ef8d56-e501-4e8f-89f8-861d57015d2c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1753 microversion: 2.20 time: 0.164557 Sep 10 14:18:31.021144 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 325/657] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:30 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:32.046236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:32.046889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:32.053610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:32.054649 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:32.055093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:32.055828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:32.056285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:32.056714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:32.243680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:32.252273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:32.253725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:32.254887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2bd04f1b-725d-4a8b-8722-da12bde30648 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.212736 Sep 10 14:18:32.255449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 333/658] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:32 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:33.281178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:33.281725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:33.288855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:33.289370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:33.289808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:33.290507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:33.290956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:33.291380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:33.487854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:33.496492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:33.497940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:33.499103 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-21a8f4b5-344c-4f76-97eb-d67a0edbba3f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.222029 Sep 10 14:18:33.499732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 326/659] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:33 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:34.525403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:34.526082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:34.532663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:34.533154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:34.533592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:34.534294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:34.534750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:34.535177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:34.683826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:34.692800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:34.694164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:34.696285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-42e66d63-6151-4707-9091-c54bbc1df7f1 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.175566 Sep 10 14:18:34.696854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 334/660] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:34 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:35.724440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:35.725022 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:35.732746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:35.733516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:35.733949 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:35.734646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:35.735353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:35.735980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:35.869972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:35.878982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:35.880719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:35.882057 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-718ba92d-d744-45fc-a397-0667dc95b903 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.163629 Sep 10 14:18:35.883194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 327/661] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:35 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:18:36.909106 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:36.909717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:36.917171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:36.917654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:36.918091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:36.918798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:36.919256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:36.919704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:36.924012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:37.063176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:37.072515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:37.074034 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:37.075531 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4e8f61b1-e957-480d-a7f5-f1db39182f84 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.170303 Sep 10 14:18:37.076104 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 335/662] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:36 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:38.103730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:38.105153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:38.113099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:38.113690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:38.114199 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:38.114998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:38.115553 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:38.116049 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:38.259288 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:38.268797 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:38.270227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:38.271389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0f64d327-4062-460b-9c7a-05be3c8b35b3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.172979 Sep 10 14:18:38.271962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 328/663] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:38 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:39.298407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:39.299458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:39.307044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:39.307916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:39.308598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:39.309667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:39.310538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:39.311167 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:39.499543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:39.509252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:39.510619 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:39.511800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1e1dc43d-6288-4e52-abca-0de303115fc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.217286 Sep 10 14:18:39.512349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 336/664] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:39 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:40.539009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:40.540452 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:40.546971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:40.547481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:40.548238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:40.548782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:40.549229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:40.549644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:40.728124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:40.739796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:40.742758 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:40.744309 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-281c4ce0-0b3d-4e7a-ba8b-96942bb9f8a3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.210279 Sep 10 14:18:40.744951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 329/665] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:40 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:41.772821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:41.774682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:41.782652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=46 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:41.785287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:41.786701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:41.787372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:41.788736 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:41.789568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:41.790284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:41.976551 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:41.989920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:41.992145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:41.993570 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-baa20080-f109-4392-b184-8479b3536364 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.225336 Sep 10 14:18:42.009201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 337/666] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:41 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:43.022326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:43.023251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:43.029679 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:43.030172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:43.030611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:43.031314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:43.031901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:43.032323 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:43.273552 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:43.285929 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:43.287564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:43.289512 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-321f7975-d9d0-40e9-8427-9e639b45f958 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.271272 Sep 10 14:18:43.290788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 330/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:43 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:44.318503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:44.320482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:44.331029 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:44.331681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:44.332305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:44.333312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:44.333925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:44.334667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:44.712466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:44.723353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:44.724928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:44.726772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5b68272e-519a-4f17-9585-fe62a86bfd96 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.412831 Sep 10 14:18:44.732287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 338/668] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:44 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:45.759484 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:45.761004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:45.768292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:45.769190 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:45.769781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:45.770644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:45.771253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:45.771993 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:45.971054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:45.981771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:45.983774 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:45.985619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4c5b5f25-a775-41e4-919f-54c5721b3a51 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.231841 Sep 10 14:18:45.988013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 331/669] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:45 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:47.013687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:47.014554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:47.023920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:47.024972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:47.025608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:47.026521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:47.031830 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:47.032532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:47.353668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:47.363716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:47.365676 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:47.367100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-dea47123-cba8-41f1-9172-0a92b3e5d649 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.359391 Sep 10 14:18:47.368541 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 339/670] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:47 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:48.407836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:48.409958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:48.420043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:48.420809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:48.421486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:48.431313 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:48.437973 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:48.437973 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:48.617259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:48.621805 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:48.635849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:48.637690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:48.639138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9f08d051-ff99-424a-8d84-dd958f829901 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.247079 Sep 10 14:18:48.639755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 332/671] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:48 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:49.667293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:49.667939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:49.683602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:49.684438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:49.685251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:49.686296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:49.686971 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:49.687549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:49.899360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:49.913771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:49.915836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:49.917303 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d052b317-b8bd-4dc9-8f90-32634888683b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.254449 Sep 10 14:18:49.918112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 340/672] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:49 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:50.946913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:50.948299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:50.952367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:18:50.958732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:50.960255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:50.960772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:50.961696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:50.962526 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:50.963616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:51.353881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:51.363607 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:51.365365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:51.367458 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cd4e4e4b-de7e-4348-be4e-d67d43bf8875 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.425310 Sep 10 14:18:51.368217 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 333/673] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:50 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:52.394428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:52.396073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:52.408296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:52.409893 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:52.410541 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:52.414487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:52.415175 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:52.416282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:52.658331 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:52.670324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:52.672057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:52.674171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-046fab57-c389-4d3a-9570-a795b0fb4e18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.283692 Sep 10 14:18:52.675666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 341/674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:52 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:53.703293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:53.704221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:53.712746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:53.714238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:53.714949 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:53.716465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:53.721406 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:53.722120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:53.894955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:53.908807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:53.913831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:53.915239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9cacb8e5-49bd-4cd4-8288-174b85539708 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.215831 Sep 10 14:18:53.916069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 334/675] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:53 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:54.942379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:54.943608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:54.956674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:54.957176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:54.957620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:54.958333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:54.958791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:54.959221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:55.116753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:55.128889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:55.131051 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:55.132710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d869e73e-8f77-4a78-8c27-e92b5681d1bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.194118 Sep 10 14:18:55.133826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 342/676] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:54 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:56.162079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:56.163496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:56.170207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:56.170771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:56.171275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:56.172084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:56.172742 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:56.173361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:56.331062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:56.342009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:56.343470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:56.344718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-671710ed-79fb-45f6-bc83-9395aec8e78e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.186825 Sep 10 14:18:56.345590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 335/677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:56 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:57.370689 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:57.372109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:57.376509 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:18:57.376723 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sat Sep 10 14:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 (ip 10.222.0.26) !!! Sep 10 14:18:57.383323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:57.383847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:57.384293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:57.385019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:57.385491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:57.385960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:57.540152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:57.549341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:57.550795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:57.552013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-95eb4b1f-7411-4488-93e8-4cae6bff2942 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.185439 Sep 10 14:18:57.552903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 343/678] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:57 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:58.582635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:58.583294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:58.590164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:58.591016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:58.591733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:58.592738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:58.593359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:58.593946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:58.740534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:58.752775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:58.754392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:58.755581 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8976ff91-bfa3-4b06-b100-80b73f3cdd18 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.177377 Sep 10 14:18:58.756133 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 336/679] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:58 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:18:59.782421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:18:59.782983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:18:59.789659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:59.790148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:59.790572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:59.791265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:18:59.793205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:18:59.793968 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:18:59.951526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:59.962509 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:59.964206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:18:59.965435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-92835f27-b881-4e9d-8e96-ab1a21561b1b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.187206 Sep 10 14:18:59.966008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 344/680] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:18:59 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:00.624358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f9a38501-f521-41b2-a9ba-d1b4e1dfcb30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Action: 'create', calling method: .version_select at 0x7ff6b7067af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1874082818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO08Uz2MyyXHfkk4Lf6IeTXsiFtANZdo+t73K67RnLd0MY/cfdH5nm/u3ta3nEDwh5ZPBwgXdC6L7EiBAifkDfWLwkXUycCflFCoRNe94MTUDVI21sTcPfrowc2ASQ2ow=="}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:00.640421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-f9a38501-f521-41b2-a9ba-d1b4e1dfcb30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Getting quotas for project 6109b45e7ff14addb54c4bff4fb43df6. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:19:00.644315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-f9a38501-f521-41b2-a9ba-d1b4e1dfcb30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Getting quotas for user 993bf8937c8349e7887b3825a7034367 and project 6109b45e7ff14addb54c4bff4fb43df6. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:19:00.670722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f9a38501-f521-41b2-a9ba-d1b4e1dfcb30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050174 Sep 10 14:19:00.671323 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 337/681] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:19:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:00.724322 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-236038094", "imageRef": "283e57fc-3bbe-41a2-bacb-6f3f81eeb595", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1874082818", "networks": [{"uuid": "3abdf3b1-acb4-40b8-8359-2185440f3388"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:00.778724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] validate_networks() for [('3abdf3b1-acb4-40b8-8359-2185440f3388', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:19:00.993937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:00.994552 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:01.000569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:01.001056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:01.001514 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:01.002375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:01.002737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:01.003167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:01.138515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:01.148158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:01.149649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:01.150923 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ff8c4a6d-4f82-450a-b1fc-751805af3913 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.161387 Sep 10 14:19:01.151507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 338/682] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:00 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:01.210534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:19:01.211047 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:19:01.211435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:19:01.211879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:19:01.212293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:19:01.221010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:01.221496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:01.221928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:01.222652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:01.223108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:01.223561 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:01.241676 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Getting quotas for project 6109b45e7ff14addb54c4bff4fb43df6. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:19:01.245743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Getting quotas for user 993bf8937c8349e7887b3825a7034367 and project 6109b45e7ff14addb54c4bff4fb43df6. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:19:01.257151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:19:01.259406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='283e57fc-3bbe-41a2-bacb-6f3f81eeb595',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:19:01.306731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9297d1d2-df81-483b-8bf4-c1021aaeb892 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587489 Sep 10 14:19:01.307384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 345/683] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:19:01.318658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-97806c84-295a-470a-a2d5-4547f792df15 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:01.319533 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-97806c84-295a-470a-a2d5-4547f792df15 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:01.383226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-97806c84-295a-470a-a2d5-4547f792df15 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:01.390717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-97806c84-295a-470a-a2d5-4547f792df15 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1258 microversion: 2.1 time: 0.075829 Sep 10 14:19:01.391283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 339/684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:01 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:02.177139 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:02.177666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:02.183966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:02.184450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:02.184879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:02.185557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:02.186006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:02.186577 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:02.323226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:02.331835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:02.333260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:02.334409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-03774e02-208e-439c-aac8-f98fa4d7f6ec tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.161809 Sep 10 14:19:02.334951 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 346/685] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:02 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:02.413673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:02.414393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:02.421347 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:02.421828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:02.422296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:02.422984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:02.423432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:02.423948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:02.484475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:02.492479 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0447db65-aad8-492c-b67c-1d4cc22856f5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1310 microversion: 2.1 time: 0.082653 Sep 10 14:19:02.493045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 340/686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:02 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:02.833690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-74de98d7-bf5e-4e05-830c-88c2bfd1c120 req-5aa856e8-c954-48a6-bdaf-568d44f2527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "name": "network-vif-plugged", "status": "completed", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:02.845633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-74de98d7-bf5e-4e05-830c-88c2bfd1c120 req-5aa856e8-c954-48a6-bdaf-568d44f2527c service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:02.847076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-74de98d7-bf5e-4e05-830c-88c2bfd1c120 req-5aa856e8-c954-48a6-bdaf-568d44f2527c service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:02.847622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-74de98d7-bf5e-4e05-830c-88c2bfd1c120 req-5aa856e8-c954-48a6-bdaf-568d44f2527c service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:02.869904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-74de98d7-bf5e-4e05-830c-88c2bfd1c120 req-5aa856e8-c954-48a6-bdaf-568d44f2527c service nova] Creating event network-vif-plugged:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:19:02.876225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-74de98d7-bf5e-4e05-830c-88c2bfd1c120 req-5aa856e8-c954-48a6-bdaf-568d44f2527c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045975 Sep 10 14:19:02.877858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 347/687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:03.361255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:03.361832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:03.368856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:03.369281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:03.370349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:03.371088 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:03.371806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:03.372236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:03.517296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:03.518057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:03.534337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:03.535336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:03.536072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:03.537722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:03.539532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:03.540372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:03.564894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:03.576672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:03.578439 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:03.580508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-484218d1-3184-4111-8c9b-50999c132d27 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.222804 Sep 10 14:19:03.597258 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 341/688] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:03 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:03.646926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:03.655327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ce8a7b9b-cb56-45f6-9d7d-fba32e66d64a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1316 microversion: 2.1 time: 0.143370 Sep 10 14:19:03.659783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 348/689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:03 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:04.608569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:04.609185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:04.616289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:04.617053 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:04.617766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:04.618652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:04.619278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:04.619894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:04.678221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:04.678945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:04.690727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:04.691310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:04.691862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:04.692640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:04.693165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:04.693656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:04.853432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:04.862364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:04.862755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:04.871971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:04.873341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-79a7a487-fdf2-4fb0-9b86-0e632de5fa52 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.268513 Sep 10 14:19:04.873591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5e8b22e4-1f67-412a-ba9d-7c6982fa76df tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.198825 Sep 10 14:19:04.884152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 342/690] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:04 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:04.885196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 349/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:04 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:04.969633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-c38ed6d6-fc4b-481c-9fe0-070bebc07332 req-2dcd9290-bf77-4ced-bb9f-fc08b984698a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:04.982673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-c38ed6d6-fc4b-481c-9fe0-070bebc07332 req-2dcd9290-bf77-4ced-bb9f-fc08b984698a service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:04.983243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-c38ed6d6-fc4b-481c-9fe0-070bebc07332 req-2dcd9290-bf77-4ced-bb9f-fc08b984698a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:04.985840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-c38ed6d6-fc4b-481c-9fe0-070bebc07332 req-2dcd9290-bf77-4ced-bb9f-fc08b984698a service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:04.997536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-c38ed6d6-fc4b-481c-9fe0-070bebc07332 req-2dcd9290-bf77-4ced-bb9f-fc08b984698a service nova] Creating event network-changed:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:19:05.003099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-c38ed6d6-fc4b-481c-9fe0-070bebc07332 req-2dcd9290-bf77-4ced-bb9f-fc08b984698a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037096 Sep 10 14:19:05.004284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 343/692] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:05.900529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:05.901142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:05.907646 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:05.908133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:05.908524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:05.908942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:05.909250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:05.909362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:05.909705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:05.910128 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:05.916143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:05.916593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:05.917220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:05.917950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:05.918411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:05.918837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:06.076628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:06.087131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:06.088702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:06.089883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bb5afdd0-b287-460c-a6a3-3a7363da735d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.193515 Sep 10 14:19:06.090446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 350/693] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:05 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:06.092860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:06.101915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1b1e921f-2bee-46f9-b722-d22745addfae tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.197484 Sep 10 14:19:06.102486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 344/694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:05 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:07.117043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:07.117838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:07.126078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:07.127517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:07.136090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:07.136588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:07.136941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:07.137078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:07.137429 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:07.137712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:07.137859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:07.138170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:07.138546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:07.138666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:07.138993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:07.139406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:07.143562 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=87 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:07.286084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:07.295275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ea9b0ecb-2a46-4b84-8b90-738dd8b49b77 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.172993 Sep 10 14:19:07.296270 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 345/695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:07 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:07.307540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:07.316229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:07.317817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:07.318994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c7db5559-713e-466d-a205-338f197d0b74 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.205949 Sep 10 14:19:07.319563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 351/696] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:07 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:08.319815 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:08.320545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:08.328595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:08.329485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:08.329873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:08.330744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:08.331198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:08.331645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:08.345221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:08.345828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:08.352522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:08.353557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:08.354002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:08.354700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:08.355157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:08.355608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:08.496856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:08.506756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0d77ffbb-edaa-4976-a1eb-fa862f16c06f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.190881 Sep 10 14:19:08.510272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 346/697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:08 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:08.523336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:08.533136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:08.534772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:08.535961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-12d9d10f-72cc-479c-b384-cc3244cc9993 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.194705 Sep 10 14:19:08.536542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 352/698] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:08 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:09.531053 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:09.531953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:09.539300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:09.539902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:09.540431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:09.542206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:09.542830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:09.543327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:09.563768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:09.565466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:09.574693 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:09.576164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:09.576950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:09.577682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:09.578316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:09.578743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:09.699413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:09.707200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3c7c6255-5656-4621-9e6b-6196fdeb30c4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.179971 Sep 10 14:19:09.723930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 347/699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:09 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:09.724585 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:09.733848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:09.735293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:09.736755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-beb30608-9455-426c-8d1c-a4db4f4d506a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.178245 Sep 10 14:19:09.737306 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 353/700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:09 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:10.730941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:10.731622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:10.738310 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:10.738795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:10.739231 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:10.739960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:10.740416 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:10.740845 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:10.762831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:10.763737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:10.771062 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:10.771563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:10.772070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:10.772799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:10.773400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:10.774024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:10.903061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:10.910796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-fa32da50-84ec-49ff-af1d-42098823832d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.184218 Sep 10 14:19:10.911365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 348/701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:10 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:10.925460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:10.935605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:10.937027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:10.938204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7ed864ac-859d-4489-bdc6-f63c3838d80b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.179935 Sep 10 14:19:10.938753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 354/702] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:10 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:11.934416 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:11.935046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:11.937023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:11.942988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:11.943498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:11.943932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:11.944612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:11.945064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:11.945485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:11.966169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:11.966765 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:11.968660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:11.969329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:11.970675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:11.987253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:11.987784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:11.988223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:11.988993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:11.989453 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:11.989882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:12.110984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:12.118558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-acb0a710-6f88-4901-850d-6011477b9f30 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.188601 Sep 10 14:19:12.119130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 349/703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:11 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:12.152126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:12.161343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:12.162964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:12.164174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-18d0f404-83b7-4fb2-8149-ea8ace607335 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.202870 Sep 10 14:19:12.172909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 355/704] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:11 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:13.142338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:13.142969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:13.149207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:13.149684 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:13.150118 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:13.150799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:13.151550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:13.151977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:13.192277 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:13.193557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:13.201257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:13.201736 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:13.202171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:13.202925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:13.203380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:13.203826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:13.339865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:13.347524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-89ab974e-6074-4cc4-8ccc-85e509d8becf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.209004 Sep 10 14:19:13.348095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 350/705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:13 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:13.362942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:13.372187 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:13.373666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:13.374840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5bad96b3-5bc4-423b-89a3-9684b791a0cf tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.186874 Sep 10 14:19:13.375596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 356/706] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:13 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:14.372572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:14.373179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:14.379586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:14.380066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:14.380493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:14.381168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:14.381613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:14.382029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:14.407170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:14.407170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:14.408452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:14.409026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:14.409569 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:14.410386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:14.410945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:14.411436 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:14.525551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:14.533426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3e6ed356-9a93-4941-a67d-34369aaac7c3 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.165566 Sep 10 14:19:14.534032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 351/707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:14 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:14.567752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:14.576563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:14.578014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:14.579176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c06abdfe-9dfd-41c8-90a2-1cdb7dfe898f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.182335 Sep 10 14:19:14.579779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 357/708] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:14 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:15.556706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:15.557947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:15.564496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:15.564982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:15.565414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:15.566097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:15.566547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:15.566969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:15.570907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:15.606224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:15.606865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:15.613563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:15.614042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:15.614469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:15.615157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:15.615630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:15.616058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:15.701563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:15.709227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3999b6e2-28b3-4923-ac30-e9564980f43b tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.156335 Sep 10 14:19:15.709803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 352/709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:15 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:15.748049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:15.756560 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:15.757997 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:15.759149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c623b6ca-2b5d-4759-ad18-eb49ac23e635 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.157640 Sep 10 14:19:15.759762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 358/710] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:15 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:16.733001 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:16.733607 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:16.740281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:16.740768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:16.741200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:16.741886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:16.742335 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:16.742756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:16.785289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:16.785876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:16.792840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:16.793314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:16.793745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:16.794434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:16.794881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:16.795298 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:16.874843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:16.883004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-40b35d9c-5533-4cd2-b919-7287da7dcca6 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.154299 Sep 10 14:19:16.883787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 353/711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:16 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:16.929439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:16.938180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:16.939664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:16.940832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d5a23a03-aac2-4291-a60c-92e2bc51845b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.159683 Sep 10 14:19:16.941390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 359/712] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:16 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:17.906223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:17.906754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:17.913168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:17.913652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:17.914087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:17.914770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:17.915222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:17.915677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:17.967026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:17.967696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:17.974082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:17.974566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:17.974998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:17.975718 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:17.976169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:17.976590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:18.048146 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:18.055914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d37890fd-c235-4de1-bd9f-9b0648fa8a6c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.153597 Sep 10 14:19:18.056693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 354/713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:17 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:18.106243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:18.115178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:18.116655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:18.117815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-90fd3d23-e2fd-4c16-827f-32c9119a43a5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.155259 Sep 10 14:19:18.118372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 360/714] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:17 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:19.078106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:19.078765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:19.085273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:19.085764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:19.086197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:19.087041 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:19.087521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:19.087948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:19.144023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:19.144586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:19.151924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:19.152614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:19.153054 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:19.153756 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:19.154210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:19.154634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:19.291733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:19.299516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:19.301412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:19.302884 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:19.304068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fd02f685-cbf7-4477-ac7b-9555612ac08b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1809 microversion: 2.20 time: 0.164070 Sep 10 14:19:19.304617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 361/715] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:19 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:19:19.307534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-61587051-f40e-470b-a655-ebeb19d96681 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.233150 Sep 10 14:19:19.311484 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 355/716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:19 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:20.329539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:20.330151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:20.332252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:20.333350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:20.337308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:20.337794 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:20.338234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:20.339698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:20.340151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:20.340573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:20.341197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:20.341689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:20.342130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:20.342832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:20.343294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:20.343755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:20.476129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:20.486076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:20.487792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:20.489061 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1913b511-c505-451a-b7f2-80a67297205d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1796 microversion: 2.20 time: 0.163395 Sep 10 14:19:20.489789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 362/717] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:19:20 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1796 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:19:20.546468 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:20.554429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ff491772-14d4-4a84-bc82-14be513b622c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.225931 Sep 10 14:19:20.555102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 356/718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:20 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:21.577782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:21.578395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:21.585003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:21.585526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:21.585969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:21.586652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:21.587110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:21.587567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:21.715118 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:21.722735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d69527c6-82ef-4086-b15a-b02aa838af8c tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.148849 Sep 10 14:19:21.723303 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 363/719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:21 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:22.745845 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:22.746465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:22.748914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:22.754100 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:22.754587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:22.755024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:22.755744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:22.756203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:22.756632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:22.889267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:22.896948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-feaa6ec4-8fce-4f78-8a46-6820d011d8aa tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.155180 Sep 10 14:19:22.897523 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 357/720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:22 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:23.919108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:23.919767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:23.926316 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:23.926802 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:23.927239 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:23.927959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:23.928417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:23.928844 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:24.059706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:24.067180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2e1b0698-f2e9-4027-9333-8d3c8b9d3662 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.152046 Sep 10 14:19:24.067776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 364/721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:23 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:25.090115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:25.090755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:25.097239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:25.097754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:25.098191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:25.098879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:25.099334 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:25.099778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:25.232352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:25.240256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-290a51db-e83b-4356-8ed1-aa74be089db4 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.154195 Sep 10 14:19:25.240826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 358/722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:25 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:26.264110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:26.264718 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:26.271009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:26.271505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:26.271936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:26.272610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:26.273058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:26.273478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:26.400759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:26.408890 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b9bd3fc9-d295-4977-8244-664d8e7d3608 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.149412 Sep 10 14:19:26.409451 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 365/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:26 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:27.116193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-3f11a6ee-9f8a-4ce9-b750-046d55f8e964 req-e40cd607-9d51-447d-9e0d-f8c1d9eae772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "name": "network-vif-plugged", "status": "completed", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:27.126320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-3f11a6ee-9f8a-4ce9-b750-046d55f8e964 req-e40cd607-9d51-447d-9e0d-f8c1d9eae772 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:27.126804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-3f11a6ee-9f8a-4ce9-b750-046d55f8e964 req-e40cd607-9d51-447d-9e0d-f8c1d9eae772 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:27.127234 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-3f11a6ee-9f8a-4ce9-b750-046d55f8e964 req-e40cd607-9d51-447d-9e0d-f8c1d9eae772 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:27.138272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-3f11a6ee-9f8a-4ce9-b750-046d55f8e964 req-e40cd607-9d51-447d-9e0d-f8c1d9eae772 service nova] Creating event network-vif-plugged:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:19:27.143255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-3f11a6ee-9f8a-4ce9-b750-046d55f8e964 req-e40cd607-9d51-447d-9e0d-f8c1d9eae772 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147344 Sep 10 14:19:27.143937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 359/724] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:27.431492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:27.432419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:27.439203 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:27.439716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:27.440563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:27.440857 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:27.441302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:27.441722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:27.572059 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:27.579655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b3e11316-26fe-4b91-b192-c104470015d5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.152048 Sep 10 14:19:27.580209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 366/725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:27 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:28.079556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "002587c6-4ccb-4928-b3ca-b5947f783cdc"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:28.082030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:28.088193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:28.089226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:28.089665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:28.090353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:28.090805 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:28.091227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:28.602521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:28.603337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:28.610411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:28.611124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:28.611581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:28.612274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:28.612725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:28.613143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:28.749630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:28.751852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:28.758767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-eae1907c-34ec-4edd-aeaa-030d56452d44 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1358 microversion: 2.1 time: 0.159934 Sep 10 14:19:28.759432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 367/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:28 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:28.773226 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-18d518d8-e38a-494f-a39e-8f02d37c683d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794534 Sep 10 14:19:28.776988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 360/727] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:19:27 2022] POST /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:19:29.782307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:29.782917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:29.788853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:29.789338 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:29.789771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:29.790459 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:29.791674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:29.792108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:29.926942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:29.935581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8f5c0cf0-65c9-4a6a-bb4f-f3cb8899c570 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1549 microversion: 2.1 time: 0.157111 Sep 10 14:19:29.936151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 368/728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:29 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:29.959162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:29.959821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:29.966817 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:29.967259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:29.967725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:29.968418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:29.968872 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:29.969294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:30.096155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:30.103754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b5e1dbf8-680c-4680-88be-e775e631b640 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1549 microversion: 2.1 time: 0.148821 Sep 10 14:19:30.104330 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 361/729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:29 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:30.126870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:30.131747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:30.132513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Searching by: {'deleted': False, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6'} {{(pid=120617) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 14:19:30.139155 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:30.139677 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:30.140113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:30.140837 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:30.141288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:30.141711 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:30.232684 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.multi_cell_list [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120617) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 14:19:30.327031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1597c7c7-c152-4674-81fe-323e28f42ba0 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203841 Sep 10 14:19:30.327634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 369/730] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 10 14:19:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:30.339186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:30.340378 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:30.346401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:30.346886 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:30.347327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:30.348054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:30.348513 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:30.348938 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:30.478022 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:30.486067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b48bb451-9dcf-423f-87a6-87f0901ee1b2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1549 microversion: 2.1 time: 0.150414 Sep 10 14:19:30.486572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 362/731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:30 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:32.023663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0e33e89-24bd-4a25-806e-45149ad1c16f"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:32.026031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:32.033226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:32.033714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:32.034154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:32.034847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:32.035302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:32.035759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:32.307321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f831bc2d-ae91-4457-b3b7-777bb9083165 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287499 Sep 10 14:19:32.308027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 370/732] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:19:32 2022] POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:37.377024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:37.379249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:37.385644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:37.386136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:37.386555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:37.387235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:37.388403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:37.389093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:37.415260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'flavor' on Instance uuid 9ae4dfd1-21db-43b2-82d4-6810bbec230c {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:19:37.540196 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-48393ed5-3430-4253-945d-9d1b861d220b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/action" status: 200 len: 32 microversion: 2.1 time: 0.167476 Sep 10 14:19:37.540810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 363/733] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:19:37 2022] POST /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:19:37.552044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:37.552941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:37.559097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:37.559768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:37.560216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:37.560911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:37.561370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:37.561799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:37.706763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:37.715257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d6a081dd-d4b4-4d9c-b0ec-05ab77a3ffdb tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.168561 Sep 10 14:19:37.715899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 371/734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:37 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:38.739161 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:38.739892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:38.746582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:38.747101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:38.747658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:38.748368 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:38.748825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:38.749250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:38.885096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:38.895817 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-818e9d2c-6fa7-474f-a488-7b9584e261a8 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.161029 Sep 10 14:19:38.896486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 364/735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:38 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:38.959565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:38.960052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:38.966757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:38.967240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:38.967704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:38.968387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:38.968841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:38.969262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:39.093403 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lazy-loading 'services' on Instance uuid 4d02053b-770b-4632-bbb2-f8867cb62341 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:19:39.203759 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-36c19ac6-acd6-44c4-816e-d478f0586519 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-volume_attachments/6faf7549-9e29-49ac-b7c8-7701b5ee02ff" status: 202 len: 0 microversion: 2.1 time: 0.350523 Sep 10 14:19:39.204346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 372/736] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:19:38 2022] DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-volume_attachments/6faf7549-9e29-49ac-b7c8-7701b5ee02ff => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 14:19:39.920012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:39.920632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:39.927021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:39.927538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:39.927977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:39.928660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:39.929114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:39.929532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:40.058952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:40.067907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bf990f8e-a847-4c52-ac52-6962e9500d74 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.151881 Sep 10 14:19:40.068471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 365/737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:39 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:41.093438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:41.094074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:41.096437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:41.102397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:41.102874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:41.103307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:41.104014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:41.104464 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:41.104879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:41.234581 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:41.242938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1401b891-9f98-459c-b9c8-37ebffe3fd87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.153994 Sep 10 14:19:41.243510 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 373/738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:41 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:42.267154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:42.267800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:42.274223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:42.274698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:42.275127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:42.275841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:42.276292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:42.276702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:42.282069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:42.411808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:42.421117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-56644fbc-96b2-48a0-8899-04980c8c3146 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.158423 Sep 10 14:19:42.421681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 366/739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:42 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:43.444494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:43.445152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:43.447523 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=38 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:43.453897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:43.454260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:43.454700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:43.455400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:43.455885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:43.456310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:43.592809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:43.600888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-59825efc-020d-49b2-a3c1-4d3276c7e282 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.160225 Sep 10 14:19:43.601451 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 374/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:43 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:44.105843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:44.107061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:44.113092 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.113571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.114005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.114686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.115140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.115590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.138415 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-702754de-9664-4ca7-8c1f-31ee40fd310c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/ips" status: 200 len: 150 microversion: 2.1 time: 0.135523 Sep 10 14:19:44.138963 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 367/741] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:19:44 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/ips => generated 150 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:19:44.150870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:44.154311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:44.160284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.160755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.161173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.161849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.162291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.162701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.393309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Invalid volume: volume 5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 is already attached to instances: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: POST /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/os-volume_attachments HTTP/1.1 Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 74 Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:19:44.395589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {"volumeAttachment": {"volumeId": "5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7"}} Sep 10 14:19:44.397208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Invalid volume: volume 5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 is already attached to instances: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'server_id': '64b950a5-ef31-4b7e-997f-eaac009116e4', 'body': {'volumeAttachment': {'volumeId': '5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7'}}} Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 is already attached to instances: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:44.398165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 is already attached to instances: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:44.399663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 is already attached to instances: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 400 to user: Invalid volume: volume 5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 is already attached to instances: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0466b316-61ed-468a-ab42-0baa69419718 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.250114 Sep 10 14:19:44.401177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 375/742] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:19:44 2022] POST /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4/os-volume_attachments => generated 174 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:19:44.405950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:44.406446 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:44.412416 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.412898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.413333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.414022 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.414484 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.414908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.441106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:19:44.518769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-16dbf5b2-8ae9-4f74-80c5-beb783678d45 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 204 len: 0 microversion: 2.1 time: 0.116294 Sep 10 14:19:44.519712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 368/743] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:19:44 2022] DELETE /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:19:44.528895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:44.529577 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:44.537272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.537869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.538282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.539243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.539499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.540058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.625626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:44.626836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:44.632766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.633249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.633679 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.634365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:44.634814 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:44.635232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:44.675018 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:44.682694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0d1ac876-7654-4046-9177-770602c5e39e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1679 microversion: 2.1 time: 0.158890 Sep 10 14:19:44.683411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 376/744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:44 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:44.764697 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:44.772811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8c1bb132-2d50-4ab7-a82d-c220ebef4374 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.151566 Sep 10 14:19:44.773371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 369/745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:44 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:45.198511 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:45.199153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:45.205882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:45.206364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:45.206795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:45.207552 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:45.208011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:45.208432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:45.338789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:45.346991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-716407cb-ffdf-4312-8042-2d6661100c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1595 microversion: 2.1 time: 0.152277 Sep 10 14:19:45.347712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 377/746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:45 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:45.705331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:45.705944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:45.712316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:45.712800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:45.713254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:45.713921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:45.714381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:45.714802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:45.796833 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:45.797458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:45.803902 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:45.804394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:45.804831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:45.805960 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:45.806058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:45.806406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:45.895245 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:45.903296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ec3170e8-fdb1-4381-9898-b9f02b3a1c01 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1679 microversion: 2.1 time: 0.201796 Sep 10 14:19:45.904211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 370/747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:45 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:45.943881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:45.952357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6237728e-6866-4927-bf9c-43be6aab3189 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.160105 Sep 10 14:19:45.952923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 378/748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:45 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:46.928216 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:46.929091 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:46.936760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:46.937250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:46.937681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:46.938374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:46.938824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:46.939243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:46.975691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:46.976311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:46.983306 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:46.983827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:46.984269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:46.985009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:46.985474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:46.986147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:47.193058 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:47.203056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2cadbc68-9b2d-4e8d-b927-a6dd206f6c3e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.231314 Sep 10 14:19:47.204041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 379/749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:46 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:47.215145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:47.225564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dda4afb7-d4ad-423a-8552-9ddd3b242e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1679 microversion: 2.1 time: 0.301046 Sep 10 14:19:47.226408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 371/750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:46 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1679 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:47.799008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-765321c5-2ede-4bd4-934a-af06d353a451 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:47.806388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-765321c5-2ede-4bd4-934a-af06d353a451 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:47.807037 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-765321c5-2ede-4bd4-934a-af06d353a451 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:47.807871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-765321c5-2ede-4bd4-934a-af06d353a451 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:47.879936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-765321c5-2ede-4bd4-934a-af06d353a451 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Going to try to stop instance {{(pid=120617) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 14:19:47.935989 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-765321c5-2ede-4bd4-934a-af06d353a451 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action" status: 202 len: 0 microversion: 2.1 time: 0.142884 Sep 10 14:19:47.937184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 380/751] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:19:47 2022] POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:19:47.946689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:47.947493 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:47.957319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:47.958021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:47.958629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:47.960025 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:47.960656 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:47.961244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.060678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-3f582753-0aa6-4b5f-9b1d-d3653fa635af req-bc7fbbce-5bae-426d-a293-20b96cb14f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:48.085308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-3f582753-0aa6-4b5f-9b1d-d3653fa635af req-bc7fbbce-5bae-426d-a293-20b96cb14f65 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:48.085926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-3f582753-0aa6-4b5f-9b1d-d3653fa635af req-bc7fbbce-5bae-426d-a293-20b96cb14f65 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:48.086437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-3f582753-0aa6-4b5f-9b1d-d3653fa635af req-bc7fbbce-5bae-426d-a293-20b96cb14f65 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.097411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:48.103040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-3f582753-0aa6-4b5f-9b1d-d3653fa635af req-bc7fbbce-5bae-426d-a293-20b96cb14f65 service nova] Creating event network-changed:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:19:48.112964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-3f582753-0aa6-4b5f-9b1d-d3653fa635af req-bc7fbbce-5bae-426d-a293-20b96cb14f65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129536 Sep 10 14:19:48.114169 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 381/752] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:48.163283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:48.180436 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7b7b1127-567f-4639-a853-36e173c6e6c6 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.238177 Sep 10 14:19:48.181029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 372/753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:47 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:48.251958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:48.253386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:48.254345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:48.256771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:48.281647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:48.282151 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:48.282592 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.283878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:48.284378 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:48.285904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:48.286364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:48.286790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.287388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.288644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:48.291292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:48.293501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.414237 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:48.422481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f1b200a2-af6e-4171-b539-ae9b666ca315 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1613 microversion: 2.1 time: 0.176008 Sep 10 14:19:48.423162 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 373/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:48 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1613 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:48.602969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:48.615272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-88854181-c65a-4e4b-b862-4f6ce2d9ad86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.389369 Sep 10 14:19:48.615900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 382/755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:48 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:48.689370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-110d15fe-9814-4eba-ac36-80915b544d86 req-5bf60542-7c12-4bb3-a9ae-051797ee3980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b950a5-ef31-4b7e-997f-eaac009116e4", "name": "network-vif-deleted", "tag": "46486132-4830-45f3-b475-3aa79de871fd"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:48.736676 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-110d15fe-9814-4eba-ac36-80915b544d86 req-5bf60542-7c12-4bb3-a9ae-051797ee3980 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:48.744299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-110d15fe-9814-4eba-ac36-80915b544d86 req-5bf60542-7c12-4bb3-a9ae-051797ee3980 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:48.747861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-110d15fe-9814-4eba-ac36-80915b544d86 req-5bf60542-7c12-4bb3-a9ae-051797ee3980 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:48.783116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-110d15fe-9814-4eba-ac36-80915b544d86 req-5bf60542-7c12-4bb3-a9ae-051797ee3980 service nova] Creating event network-vif-deleted:46486132-4830-45f3-b475-3aa79de871fd for instance 64b950a5-ef31-4b7e-997f-eaac009116e4 on hv-cinder-85690 Sep 10 14:19:48.792783 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-110d15fe-9814-4eba-ac36-80915b544d86 req-5bf60542-7c12-4bb3-a9ae-051797ee3980 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236355 Sep 10 14:19:48.796075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 374/756] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:19:49.208988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:49.210002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:49.237906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.238781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.240473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:49.241440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.244500 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.252520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:49.448821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:49.449718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:49.463510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.464169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.464721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:49.465579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.466145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.467776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:49.497397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:49.508894 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fb782028-9763-4d20-880b-32a7a94910a4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.305929 Sep 10 14:19:49.509483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 383/757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:49 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:49.547861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.550503 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.551247 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:49.551746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lazy-loading 'fault' on Instance uuid 64b950a5-ef31-4b7e-997f-eaac009116e4 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:19:49.640514 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:49.649226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:49.649853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:49.662858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.663366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.666285 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ea97b991-b6ff-405d-ba8e-1a9e620cc1a2 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 200 len: 1330 microversion: 2.1 time: 0.221626 Sep 10 14:19:49.666882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 375/758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:49 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 1330 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:49.677068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:49.678147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:49.678881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:49.679515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.013963 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:50.026109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f688c861-5f93-4734-ba05-6da1a73e1e73 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.379258 Sep 10 14:19:50.027091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 384/759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:49 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:50.030674 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1669239051"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:50.031222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:50.041148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.041877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.042481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.043360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.044776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.045487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.223851 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.network.security_group_api [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Adding security group 50014e9a-251e-4d2c-86fd-b4e3ac3efff5 to port 810f325f-bbb0-4176-bccf-7cadda251d29 Sep 10 14:19:50.538690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:50.539410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:50.546699 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.547287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.547822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.548608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.549746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.550248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.710000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:50.720274 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-325527e6-1187-4dd2-ae29-5a243b7e1c13 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.185838 Sep 10 14:19:50.721189 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 385/760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:50 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:50.728258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:50.729282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:50.738413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.739074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.739624 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.740597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.741135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.741637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.760006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 HTTP/1.1 Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:19:50.761805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:19:50.764125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '64b950a5-ef31-4b7e-997f-eaac009116e4'} Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:19:50.764981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:19:50.767576 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:50.768973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:19:50.768973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-aa0c3b18-3245-419a-99f4-4ab04c11e072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 404 len: 111 microversion: 2.1 time: 0.041681 Sep 10 14:19:50.768973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 386/761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:50 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:19:50.774726 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a00bf5c8-4521-4a59-8fe1-0119ef9571e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '.version_select at 0x7ff6b719eca0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:50.780104 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a00bf5c8-4521-4a59-8fe1-0119ef9571e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [b439857f-ba1d-4394-857d-24cd1c6b2d28] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 14:19:50.842544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b239feb0-1b05-4b4d-b261-882cafc0121a tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/action" status: 202 len: 0 microversion: 2.1 time: 0.816151 Sep 10 14:19:50.843791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 376/762] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:19:50 2022] POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:19:50.850791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-5c2e66af-c4ba-4be4-a6e2-09b478c94e3b req-4817ee0b-1118-4bca-9dcd-7fb6b7e515f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:50.861918 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5c2e66af-c4ba-4be4-a6e2-09b478c94e3b req-4817ee0b-1118-4bca-9dcd-7fb6b7e515f1 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.862558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5c2e66af-c4ba-4be4-a6e2-09b478c94e3b req-4817ee0b-1118-4bca-9dcd-7fb6b7e515f1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.863246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-5c2e66af-c4ba-4be4-a6e2-09b478c94e3b req-4817ee0b-1118-4bca-9dcd-7fb6b7e515f1 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.877785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-5c2e66af-c4ba-4be4-a6e2-09b478c94e3b req-4817ee0b-1118-4bca-9dcd-7fb6b7e515f1 service nova] Creating event network-changed:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:19:50.883209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-5c2e66af-c4ba-4be4-a6e2-09b478c94e3b req-4817ee0b-1118-4bca-9dcd-7fb6b7e515f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036500 Sep 10 14:19:50.884622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 377/763] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:50.891838 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:50.892997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:50.900359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.900789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.901232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:50.901935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:50.902595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:50.904015 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:51.169347 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:51.178098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3d950c00-fa7f-4cfb-9826-61f8c7862d67 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1760 microversion: 2.1 time: 0.292066 Sep 10 14:19:51.179287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 378/764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:50 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:51.186115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:51.186935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:51.193813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:51.194480 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:51.195107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:51.196003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:51.196961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:51.197399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:51.397418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:51.408737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cb23874f-9f31-4dcc-81e9-830d83472532 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.228125 Sep 10 14:19:51.409532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 379/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:51 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:51.744763 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:51.745299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:51.752343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:51.752771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:51.753201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:51.753877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:51.754332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:51.754743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:51.788134 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO oslo.messaging._drivers.impl_rabbit [None req-a00bf5c8-4521-4a59-8fe1-0119ef9571e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [b439857f-ba1d-4394-857d-24cd1c6b2d28] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47952. Sep 10 14:19:51.809076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a00bf5c8-4521-4a59-8fe1-0119ef9571e0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-810619547" status: 202 len: 0 microversion: 2.1 time: 1.038043 Sep 10 14:19:51.810365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 387/766] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 10 14:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-810619547 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:19:51.890811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:51.901672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f98b5f86-d70f-4427-886f-d33bfa745915 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.160660 Sep 10 14:19:51.915466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 380/767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:51 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:19:52.433295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:52.434254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:52.444410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.444950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.445418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.446128 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.446596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.447026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.564006 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:52.564658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:52.570638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.571184 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.571597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.572324 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.572781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.573207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.585962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:52.594883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-26b52436-7cb3-4c94-b78f-f837c1dfda51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.165732 Sep 10 14:19:52.595462 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 388/768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:52 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:52.655394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lazy-loading 'services' on Instance uuid 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:19:52.725014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-efe33a55-d159-40ac-a967-ed6ce8f27682 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments/5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7" status: 202 len: 0 microversion: 2.1 time: 0.165430 Sep 10 14:19:52.725666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 381/769] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:19:52 2022] DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments/5fc7d3a2-6b34-47dd-91cc-3a6590cdbda7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 14:19:52.735090 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:52.737568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:52.743852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.744398 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.745110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.746360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.746901 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.747600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.779384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-14fa7d40-3649-4d5e-8960-d7da3696b558 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 Sep 10 14:19:52.779996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 389/770] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:19:52 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:52.926904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:52.927629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:52.929533 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:52.935862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.936348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.936783 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.937471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:52.937923 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:52.938346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:52.943086 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:53.070897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:53.079283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e8ee1026-66a8-497f-bdf8-89627819ffc5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.157110 Sep 10 14:19:53.079869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 382/771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:52 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:53.618064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:53.618668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:53.625161 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:53.625639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:53.626069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:53.626747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:53.627196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:53.627648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:53.758204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:53.766853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-70e12633-d531-4423-861a-c012f70ef488 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.152591 Sep 10 14:19:53.767419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 390/772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:53 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:53.792116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:53.795360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:53.801246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:53.801726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:53.802161 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:53.802871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:53.803317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:53.803762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:53.834917 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5e41e225-148f-4234-b5e0-5c5f7d0f5763 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Sep 10 14:19:53.835495 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 383/773] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:19:53 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:54.102710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:54.103226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:54.109406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.109883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.110313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.111264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.111729 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.112145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.241054 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:54.248771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f2d73bb8-adde-459e-a20e-905020553dc9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.150060 Sep 10 14:19:54.249326 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 391/774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:54 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:54.790652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:54.791267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:54.798292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.798777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.799213 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.799928 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.800385 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.800807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.846998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:54.849154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:54.855499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.856524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.856957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.857641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.858117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.858536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.888533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4a509e02-7fe3-416f-a1cc-c6b1d181332b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045391 Sep 10 14:19:54.889241 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 392/775] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:19:54 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 14:19:54.931515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:54.940466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a4ba5908-289c-4326-9d59-055330265d86 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.153583 Sep 10 14:19:54.941027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 384/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:54 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:54.959406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:54.959923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:54.965984 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.966465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.966902 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.967623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:54.968077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:54.968498 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:54.993602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:19:55.066885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7879c8ed-e026-445b-b177-72c70c797c13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 204 len: 0 microversion: 2.1 time: 0.110944 Sep 10 14:19:55.067368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 393/777] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:19:54 2022] DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:19:55.077269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:55.078044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:55.083947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:55.084437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:55.084993 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:55.085684 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:55.086168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:55.086588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:55.216691 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:55.224288 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-309d99bd-6fe9-40d2-b0d5-5847f84ae135 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1680 microversion: 2.1 time: 0.152309 Sep 10 14:19:55.224849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 385/778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:55 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:55.272826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:55.273524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:55.280192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:55.280677 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:55.281109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:55.281790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:55.282240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:55.282658 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:55.412233 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:55.420313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6d4ceb9b-f391-4581-97fd-fb3abbe79de5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.151646 Sep 10 14:19:55.420870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 394/779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:55 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:55.963216 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:55.963841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:55.970817 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:55.971307 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:55.971807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:55.972494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:55.972950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:55.973374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:56.101570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:56.110405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c1ff1cfb-0e12-477b-b3b2-fca211fab11f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.151135 Sep 10 14:19:56.110972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 386/780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:55 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:56.248479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:56.249095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:56.255527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:56.256016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:56.256457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:56.257150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:56.257610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:56.258037 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:56.391707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:56.399940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-89b64dfc-b3e3-4e5b-bb63-240b24d1ebd4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1680 microversion: 2.1 time: 0.155411 Sep 10 14:19:56.400522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 395/781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:56 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:56.444500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:56.445115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:56.451856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:56.452350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:56.452793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:56.453498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:56.453975 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:56.454502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:56.732025 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:56.739941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7e354ed2-c3e5-4763-8e65-0d7848fdc521 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.299208 Sep 10 14:19:56.740696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 387/782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:56 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:57.133707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:57.134345 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:57.140573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.141065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.141505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.142207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.142666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.143090 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.249402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-ee3862c7-df7d-4dd6-846d-522ff7163b7e req-00128db6-e0ff-4806-9f2f-591bc15cc854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149", "name": "network-vif-deleted", "tag": "59ef42f3-b123-4299-94f1-580410905a1d"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:57.263761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-ee3862c7-df7d-4dd6-846d-522ff7163b7e req-00128db6-e0ff-4806-9f2f-591bc15cc854 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.264243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-ee3862c7-df7d-4dd6-846d-522ff7163b7e req-00128db6-e0ff-4806-9f2f-591bc15cc854 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.264667 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-ee3862c7-df7d-4dd6-846d-522ff7163b7e req-00128db6-e0ff-4806-9f2f-591bc15cc854 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.278173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-ee3862c7-df7d-4dd6-846d-522ff7163b7e req-00128db6-e0ff-4806-9f2f-591bc15cc854 service nova] Creating event network-vif-deleted:59ef42f3-b123-4299-94f1-580410905a1d for instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 on hv-cinder-85690 Sep 10 14:19:57.285041 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-ee3862c7-df7d-4dd6-846d-522ff7163b7e req-00128db6-e0ff-4806-9f2f-591bc15cc854 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046542 Sep 10 14:19:57.286014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 388/783] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:57.287134 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:57.300888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4b8e1da8-3866-411b-977b-d95d971891f4 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.170841 Sep 10 14:19:57.304307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 396/784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:57 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:57.425704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:57.427062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:57.435214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.436144 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.437004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.438159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.441956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.442707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.481308 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.481953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.482482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.483030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lazy-loading 'fault' on Instance uuid 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:19:57.533704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:57.542709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a14bd100-382c-414e-879e-7049bf80a5a0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 200 len: 1332 microversion: 2.1 time: 0.121281 Sep 10 14:19:57.543839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 389/785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:57 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:57.762866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:57.763489 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:57.769485 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.769966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.770401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.771082 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:57.771559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:57.771983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:57.904419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:57.912224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c9c01f42-46ee-4274-9c1e-e0bf5d771f53 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.153236 Sep 10 14:19:57.912805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 397/786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:57 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:58.329008 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:58.329633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:58.336497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:58.336987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:58.337423 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:58.338118 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:58.338577 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:58.339070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:58.474670 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:58.483559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-df9474ad-76b0-467c-9750-e484d1f21ba0 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.159292 Sep 10 14:19:58.484130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 390/787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:58 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:58.566659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:58.567267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:58.573999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:58.574504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:58.574962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:58.575686 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:58.576137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:58.576558 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:58.590688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 HTTP/1.1 Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:19:58.592446 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:19:58.594020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149'} Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:19:58.594818 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:19:58.596087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:19:58.597221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:19:58.597221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fce61cc1-4511-4ced-ad82-8c3c0262fee3 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 404 len: 111 microversion: 2.1 time: 0.031154 Sep 10 14:19:58.597221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 398/788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:58 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:19:58.603005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f802b174-3f5a-46fa-9cd1-ef6d1775b670 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '.version_select at 0x7ff6b700d790>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:58.625481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f802b174-3f5a-46fa-9cd1-ef6d1775b670 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462892885" status: 202 len: 0 microversion: 2.1 time: 0.026198 Sep 10 14:19:58.626051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 391/789] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 10 14:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462892885 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:19:58.936797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:58.937345 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:58.943172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:58.943682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:58.944118 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:58.944806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:58.945253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:58.945668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:58.950387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:19:59.157565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:59.165287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d683cc72-80ec-4c0e-bf08-36d54bd05ab9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.233294 Sep 10 14:19:59.165851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 399/790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:58 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:19:59.333828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dd0bb0a3-cbd3-4fba-856d-09d1a9a36bb7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: .version_select at 0x7ff6b706ac10>, body: {"keypair": {"name": "tempest-keypair-2008121697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiEtnvY8I+y+kAiDzt81ncGjK7GyrUqZQ0WPo4gCieXoJNvvFMS0jduJJWR2nI3J2S4YazHgE19Ocv9uMhE1FMLi7jJAaU4wXdIsHD7rbmkfkcNh9hUhTuVbPlpc1vAhQ=="}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:19:59.350720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-dd0bb0a3-cbd3-4fba-856d-09d1a9a36bb7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:19:59.354737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-dd0bb0a3-cbd3-4fba-856d-09d1a9a36bb7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:19:59.377984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dd0bb0a3-cbd3-4fba-856d-09d1a9a36bb7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048052 Sep 10 14:19:59.378587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 392/791] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:19:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:19:59.508131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:19:59.508785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:19:59.515731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:59.516225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:59.516667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:59.517374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:19:59.517834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:19:59.518260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:19:59.665476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:19:59.674474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ddd8967a-02dc-40de-ade4-b2824fa43dfc tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.170562 Sep 10 14:19:59.675135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 400/792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:19:59 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:00.190242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:00.190891 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:00.197576 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:00.198202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:00.198649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:00.199344 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:00.200379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:00.200804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:00.402621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:00.410586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7fb5f5bd-271a-4f83-9249-e103f64d6a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.224270 Sep 10 14:20:00.411153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 393/793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:00 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:00.698242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:00.698882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:00.706276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:00.706764 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:00.707198 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:00.707927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:00.708376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:00.708806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:00.844346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:00.852678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f55ecece-7839-4bfb-8cae-e04f9d341d4f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.158356 Sep 10 14:20:00.853250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 401/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:00 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:01.002249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1094376940", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6130204-567f-432e-9831-4386656cd324"}], "security_groups": [{"name": "tempest-securitygroup--1832847186"}], "key_name": "tempest-keypair-2008121697", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:01.109173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] validate_networks() for [('c6130204-567f-432e-9831-4386656cd324', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:20:01.433386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:01.434027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:01.441011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:01.441534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:01.441987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:01.442700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:01.443155 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:01.443613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:01.520137 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:20:01.520919 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:20:01.521282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:20:01.521538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:20:01.521974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:20:01.531564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:01.532056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:01.532491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:01.533220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:01.533676 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:01.534295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:01.551715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:20:01.555702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:20:01.566889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:20:01.569246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:20:01.572495 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:01.581078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d8bf13e0-aa35-4075-a07b-fe9d6a326b80 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.151564 Sep 10 14:20:01.581654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 402/795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:01 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:20:01.618147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-20f0a78f-4ab2-4f5f-8c08-122f8f33d875 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620211 Sep 10 14:20:01.618796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 394/796] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:20:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:20:01.630522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-90041f21-b7da-4f8d-9568-b6501618ec12 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:01.631133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-90041f21-b7da-4f8d-9568-b6501618ec12 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:01.690086 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-90041f21-b7da-4f8d-9568-b6501618ec12 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:01.697049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-90041f21-b7da-4f8d-9568-b6501618ec12 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1242 microversion: 2.1 time: 0.070317 Sep 10 14:20:01.697608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 403/797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:01 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:01.881342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:01.882045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:01.889805 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:01.890388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:01.890901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:01.891777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:01.892340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:01.893030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:02.027508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:02.037021 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dcac7808-4e53-432c-9575-4bb5807bbd8f tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1736 microversion: 2.1 time: 0.159617 Sep 10 14:20:02.037604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 395/798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:01 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:02.604807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:02.605421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:02.612936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:02.613419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:02.613856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:02.614539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:02.614993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:02.615414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:02.720187 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:02.720808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:02.727167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:02.727712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:02.728155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:02.728847 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:02.729299 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:02.729720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:02.746251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:02.754185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-152b5ae1-f69f-484d-9537-df5a69e96f51 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.153286 Sep 10 14:20:02.754846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 404/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:02 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:02.797154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:02.804738 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d39d682e-898e-4023-9c96-0a7c6978a344 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1294 microversion: 2.1 time: 0.089045 Sep 10 14:20:02.805300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 396/800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:02 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:20:03.060978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:03.061536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:03.067962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.068517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.069110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.069846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.070305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.070735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.208575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:03.218272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-51d8fbd4-55e0-4fe3-9c35-7554fdd1ee51 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1716 microversion: 2.1 time: 0.161386 Sep 10 14:20:03.218842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 405/801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:03 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:03.280952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:03.281439 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:03.287685 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.288166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.288666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.289418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.289969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.290390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.374954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] HTTP exception thrown: Cannot 'detach_volume' instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c while it is in vm_state rescued Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Request method failure captured: Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments/002587c6-4ccb-4928-b3ca-b5947f783cdc HTTP/1.1 Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuenlU242EO7D9nGmkG2doxdtT7aJBj_Zl81ZveG_OE1klgLXgfGbihLt-R8I2sCIMgegEp508v6l6nAAjcinvEzoh6InkSTUTNViKY96J74c27QLyEQITMfBToMi13MUCV8sgc-SEf8IJjYvnYtZLoleQaKt_3VrYS-qWNk7AF7iY Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:20:03.376698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cffd972dec364c89bbc04fd078dc7fd9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}] Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8f96c9a2a49047b5b8abd3b2c1475a18 Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:20:03.378264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Cannot 'detach_volume' instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c while it is in vm_state rescued Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'server_id': '9ae4dfd1-21db-43b2-82d4-6810bbec230c', 'id': '002587c6-4ccb-4928-b3ca-b5947f783cdc'} Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:20:03.378964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c while it is in vm_state rescued Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c while it is in vm_state rescued Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:03.380382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Returning 409 to user: Cannot 'detach_volume' instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c while it is in vm_state rescued {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:20:03.381566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5c432d43-fac6-4d3d-99f8-3bae05e7fb14 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments/002587c6-4ccb-4928-b3ca-b5947f783cdc" status: 409 len: 152 microversion: 2.1 time: 0.101174 Sep 10 14:20:03.381566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 397/802] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:20:03 2022] DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments/002587c6-4ccb-4928-b3ca-b5947f783cdc => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 14:20:03.386978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:03.387554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:03.394333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.394441 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.394842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.395568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.396026 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.396637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.465499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-60ea8f7a-90aa-4813-a9a7-1831c04f60ef tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "POST /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/action" status: 202 len: 0 microversion: 2.1 time: 0.082202 Sep 10 14:20:03.466662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 406/803] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:20:03 2022] POST /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:20:03.474831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:03.475437 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:03.481401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.482774 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.483234 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.483943 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.484395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.484810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.620575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:03.629060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0aaf6cab-3d78-4c7d-94cd-5102d9bbf8c7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1724 microversion: 2.1 time: 0.158030 Sep 10 14:20:03.629621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 398/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:03 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:03.778247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:03.779522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:03.787272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.787798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.788332 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.789040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.789502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.789934 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.830209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:03.832345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:03.842782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.844156 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.844924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.846371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:03.847584 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:03.848295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:03.960631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:03.972120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d247d69d-7aec-4fcb-82af-82ccd94a87a9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1302 microversion: 2.1 time: 0.147815 Sep 10 14:20:03.988327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 399/805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:03 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:04.039760 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:04.056598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ab1920d9-bcfb-499d-959e-ecf091753ac5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1677 microversion: 2.1 time: 0.281410 Sep 10 14:20:04.070916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 407/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:03 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1677 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:04.652373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:04.652984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:04.659155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:04.659689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:04.660125 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:04.660813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:04.661265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:04.661685 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:04.814792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:04.828579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3fc52a04-a3a8-484d-add4-086513d488b1 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1724 microversion: 2.1 time: 0.179932 Sep 10 14:20:04.829398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 400/807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:04 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:04.999880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:05.000479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:05.006937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.007425 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.007892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.008618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.009080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.009505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.080321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:05.080907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:05.087192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.087711 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.088149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.088834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.089280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.089703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.221205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:05.224116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:05.228970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=100 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:05.230482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7ebd529f-2d05-4572-9495-f5c45a3fc123 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.234490 Sep 10 14:20:05.231955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 408/808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:04 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:05.235501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-88177e03-1d56-4343-8b49-4f931642f748 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1654 microversion: 2.1 time: 0.158890 Sep 10 14:20:05.236130 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 401/809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:05 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:05.258714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e95035e6-c1de-48cc-984f-433dbc7664df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:05.264601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e95035e6-c1de-48cc-984f-433dbc7664df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.265115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e95035e6-c1de-48cc-984f-433dbc7664df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.265554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e95035e6-c1de-48cc-984f-433dbc7664df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.287168 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e95035e6-c1de-48cc-984f-433dbc7664df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Going to try to start instance {{(pid=120617) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 14:20:05.331387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e95035e6-c1de-48cc-984f-433dbc7664df tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action" status: 202 len: 0 microversion: 2.1 time: 0.076454 Sep 10 14:20:05.332114 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 409/810] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:20:05 2022] POST /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:20:05.340457 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:05.341079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:05.347396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.347796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.348239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.348937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.349393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.349816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.488259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:05.495981 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4428b7e1-7c9c-406f-a746-21839a9739b8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1663 microversion: 2.1 time: 0.159654 Sep 10 14:20:05.496550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 402/811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:05 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:05.535554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-2e428452-6012-484e-bafe-8b5d7e62624e req-80765ddd-04fe-443e-b0bf-9ebcfad6cc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028facf8-adb9-4054-9c61-5420c17ce80f", "tag": "8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:05.546039 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-2e428452-6012-484e-bafe-8b5d7e62624e req-80765ddd-04fe-443e-b0bf-9ebcfad6cc9d service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.546546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-2e428452-6012-484e-bafe-8b5d7e62624e req-80765ddd-04fe-443e-b0bf-9ebcfad6cc9d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.546972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-2e428452-6012-484e-bafe-8b5d7e62624e req-80765ddd-04fe-443e-b0bf-9ebcfad6cc9d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.557883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-2e428452-6012-484e-bafe-8b5d7e62624e req-80765ddd-04fe-443e-b0bf-9ebcfad6cc9d service nova] Creating event network-changed:8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04 for instance 028facf8-adb9-4054-9c61-5420c17ce80f on hv-cinder-85690 Sep 10 14:20:05.562789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-2e428452-6012-484e-bafe-8b5d7e62624e req-80765ddd-04fe-443e-b0bf-9ebcfad6cc9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031309 Sep 10 14:20:05.563383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 410/812] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:05.852372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:05.853064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:05.859641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.860119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.860551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.861482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:05.861931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:05.862347 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:05.991578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:06.000068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cb7becef-f95e-4e35-bae2-5264418bf41b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1724 microversion: 2.1 time: 0.151510 Sep 10 14:20:06.000627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 403/813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:05 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:06.255401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:06.256135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:06.262399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:06.263540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:06.263999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:06.264665 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:06.265118 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:06.265539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:06.398113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:06.406708 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a73f1001-527a-4313-ab44-4349b1bae2e6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.156004 Sep 10 14:20:06.407266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 411/814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:06 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:06.520089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:06.520627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:06.527050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:06.527561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:06.527992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:06.529004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:06.529486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:06.529926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:06.656887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:06.664446 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8e65cef2-6662-4b73-9247-57c893b5d1ca tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1663 microversion: 2.1 time: 0.148252 Sep 10 14:20:06.665006 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 404/815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:06 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:07.024060 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:07.024705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:07.031123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:07.031643 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:07.032081 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:07.032768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:07.033220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:07.033651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:07.167408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:07.176401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d0a44b13-7509-4c5f-8e0f-6a51e21ec334 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1724 microversion: 2.1 time: 0.156227 Sep 10 14:20:07.176963 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 412/816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:07 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:07.428723 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:07.429460 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:07.435649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:07.436135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:07.436570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:07.437301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:07.437752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:07.438168 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:07.565913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:07.573384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8dcd4c57-906c-4d9a-9d1c-dc7761e52abb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.148593 Sep 10 14:20:07.573950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 405/817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:07 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:07.689158 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:07.689757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:07.696094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:07.696575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:07.697012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:07.697725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:07.698176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:07.698597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:07.911765 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:07.920177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8148fe72-74ba-4c97-a9cb-30d5e97f276c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1663 microversion: 2.1 time: 0.235013 Sep 10 14:20:07.920757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 413/818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:07 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1663 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:08.201126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:08.201941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:08.208024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.208608 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.209121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.209899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.210441 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.210959 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.347406 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:08.355975 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e5b72d13-1c71-4523-92f8-5c3eeb33853b tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1730 microversion: 2.1 time: 0.159971 Sep 10 14:20:08.356873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 406/819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:08 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:08.378725 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:08.379152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:08.385164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.385617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.386393 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.387098 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.388153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.388588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.597568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:08.598157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:08.605169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.605657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.606088 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.607484 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.608099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.608557 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.704307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0462200a-b5ea-40f2-b695-53a7561db89d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.329307 Sep 10 14:20:08.705174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 414/820] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:20:08 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:08.752849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:08.760688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ac087d35-739d-4225-ac4c-9cee5ea53490 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.167214 Sep 10 14:20:08.761341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 407/821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:08 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:08.944649 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:08.945515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:08.952191 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.952675 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.953105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:08.953788 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:08.954235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:08.954653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:09.199111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:09.201924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:09.208746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-60138a22-3a18-4d9d-a971-e257c30efce1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1663 microversion: 2.1 time: 0.267954 Sep 10 14:20:09.209423 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 415/822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:08 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1663 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:09.642443 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-7d995cc8-703a-4fed-8ddc-4e947407744f req-d37919e0-e856-493b-912a-5d94898e513e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae4dfd1-21db-43b2-82d4-6810bbec230c", "tag": "9f9f16ce-e5be-47d7-aaea-0c62e3b54548"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:09.652707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-7d995cc8-703a-4fed-8ddc-4e947407744f req-d37919e0-e856-493b-912a-5d94898e513e service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:09.653215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-7d995cc8-703a-4fed-8ddc-4e947407744f req-d37919e0-e856-493b-912a-5d94898e513e service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:09.653791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-7d995cc8-703a-4fed-8ddc-4e947407744f req-d37919e0-e856-493b-912a-5d94898e513e service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:09.670327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-7d995cc8-703a-4fed-8ddc-4e947407744f req-d37919e0-e856-493b-912a-5d94898e513e service nova] Creating event network-changed:9f9f16ce-e5be-47d7-aaea-0c62e3b54548 for instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c on hv-cinder-85690 Sep 10 14:20:09.675576 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-7d995cc8-703a-4fed-8ddc-4e947407744f req-d37919e0-e856-493b-912a-5d94898e513e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037502 Sep 10 14:20:09.676185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 408/823] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:09.784362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:09.784926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:09.792470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:09.792959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:09.793399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:09.794731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:09.795226 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:09.795678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:09.932717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:09.941370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7320339e-53d1-4c1e-b13d-2bee971bd4ca tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.161831 Sep 10 14:20:09.941945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 416/824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:09 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:10.234035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:10.234736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:10.241188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:10.241686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:10.242126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:10.242824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:10.243283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:10.243735 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:10.381865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:10.391157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e24ec981-3877-419b-899a-6a78683d750b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1663 microversion: 2.1 time: 0.161969 Sep 10 14:20:10.391773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 409/825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:10 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:10.964548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:10.965286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:10.972835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:10.973298 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:10.973928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:10.974626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:10.975077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:10.975846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:11.109854 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:11.117792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e8a543e0-6604-4d79-9f68-71b1873c1dcd tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.157257 Sep 10 14:20:11.118345 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 417/826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:10 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:11.416598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:11.417205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:11.424683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:11.425170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:11.425601 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:11.426300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:11.426754 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:11.427175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:11.543147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:11.562885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=10 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:11.571080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:11.578721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ad8a4833-fa3c-4da8-8b87-203f11e4514a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1667 microversion: 2.1 time: 0.165888 Sep 10 14:20:11.579292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 410/827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:11 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:11.694179 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-42694971-efe2-4249-910b-13301e4c1117 req-09cd6a99-4cad-4cee-a896-5d32b6a759d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae4dfd1-21db-43b2-82d4-6810bbec230c", "tag": "9f9f16ce-e5be-47d7-aaea-0c62e3b54548"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:11.699192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:11.705160 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-42694971-efe2-4249-910b-13301e4c1117 req-09cd6a99-4cad-4cee-a896-5d32b6a759d3 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:11.705638 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-42694971-efe2-4249-910b-13301e4c1117 req-09cd6a99-4cad-4cee-a896-5d32b6a759d3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:11.706064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-42694971-efe2-4249-910b-13301e4c1117 req-09cd6a99-4cad-4cee-a896-5d32b6a759d3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:11.717898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-42694971-efe2-4249-910b-13301e4c1117 req-09cd6a99-4cad-4cee-a896-5d32b6a759d3 service nova] Creating event network-changed:9f9f16ce-e5be-47d7-aaea-0c62e3b54548 for instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c on hv-cinder-85690 Sep 10 14:20:11.722746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-42694971-efe2-4249-910b-13301e4c1117 req-09cd6a99-4cad-4cee-a896-5d32b6a759d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Sep 10 14:20:11.723525 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 418/828] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:12.141632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:12.142155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:12.148201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:12.148689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:12.149119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:12.149813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:12.150266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:12.150687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:12.282912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:12.290837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d89446b6-37a8-4586-825a-a8ad11b5035f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.153817 Sep 10 14:20:12.291408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 411/829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:12 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:13.315845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:13.316254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:13.322255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:13.324440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:13.324930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:13.325991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:13.326690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:13.327150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:13.327594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:13.467211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:13.474821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3c817040-2797-483d-bc05-0d6958c584fb tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.164288 Sep 10 14:20:13.475380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 419/830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:13 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:14.496881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:14.497495 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:14.504225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:14.504705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:14.505136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:14.505812 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:14.506260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:14.506677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:14.635375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:14.643067 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-239e866c-bc5d-4a3c-900f-78a7b6dac35b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.149964 Sep 10 14:20:14.643661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 412/831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:14 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:15.224945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-c2795daf-325d-44b4-ad97-48290c3a89bc req-f235c8be-7b14-415e-94f3-4cbadb65ff01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028facf8-adb9-4054-9c61-5420c17ce80f", "name": "network-vif-plugged", "status": "completed", "tag": "8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:15.236285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-c2795daf-325d-44b4-ad97-48290c3a89bc req-f235c8be-7b14-415e-94f3-4cbadb65ff01 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:15.237021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-c2795daf-325d-44b4-ad97-48290c3a89bc req-f235c8be-7b14-415e-94f3-4cbadb65ff01 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:15.237448 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-c2795daf-325d-44b4-ad97-48290c3a89bc req-f235c8be-7b14-415e-94f3-4cbadb65ff01 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:15.252609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-c2795daf-325d-44b4-ad97-48290c3a89bc req-f235c8be-7b14-415e-94f3-4cbadb65ff01 service nova] Creating event network-vif-plugged:8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04 for instance 028facf8-adb9-4054-9c61-5420c17ce80f on hv-cinder-85690 Sep 10 14:20:15.257614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-c2795daf-325d-44b4-ad97-48290c3a89bc req-f235c8be-7b14-415e-94f3-4cbadb65ff01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036297 Sep 10 14:20:15.258651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 420/832] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:15.666204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:15.666826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:15.673200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:15.673687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:15.674128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:15.674818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:15.675275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:15.675728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:15.805170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:15.813205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e51c22fb-5652-451a-8544-30471e1d8497 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.150919 Sep 10 14:20:15.813769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 413/833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:15 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:16.836528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:16.837253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:16.844140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:16.844620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:16.845062 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:16.845745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:16.846200 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:16.846622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:16.975911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:16.983939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-63695688-a301-427f-b303-4eb65ff875d5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1368 microversion: 2.1 time: 0.151518 Sep 10 14:20:16.984510 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 421/834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:16 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:18.006946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:18.007621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:18.014680 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:18.015198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:18.015667 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:18.016352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:18.016802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:18.017221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:18.145485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:18.153066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-858a611a-ded8-48f4-aec8-454aa29e8504 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1557 microversion: 2.1 time: 0.149939 Sep 10 14:20:18.153626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 414/835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:20:18 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:18.175638 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:18.176145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:18.182512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:18.182994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:18.183435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:18.184185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:18.184651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:18.185097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:18.266050 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-16fbc279-a6b2-4bba-9a38-906c4660f1c6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094306 Sep 10 14:20:18.266670 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 422/836] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:20:18 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:20:19.418132 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-fc61827e-a3d2-4637-83cd-4a58c5d5809b req-bf84267b-2e51-4e14-b6d8-61069605caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028facf8-adb9-4054-9c61-5420c17ce80f", "tag": "8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:19.428841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-fc61827e-a3d2-4637-83cd-4a58c5d5809b req-bf84267b-2e51-4e14-b6d8-61069605caa7 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:19.429412 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-fc61827e-a3d2-4637-83cd-4a58c5d5809b req-bf84267b-2e51-4e14-b6d8-61069605caa7 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:19.429910 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-fc61827e-a3d2-4637-83cd-4a58c5d5809b req-bf84267b-2e51-4e14-b6d8-61069605caa7 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:19.442596 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-fc61827e-a3d2-4637-83cd-4a58c5d5809b req-bf84267b-2e51-4e14-b6d8-61069605caa7 service nova] Creating event network-changed:8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04 for instance 028facf8-adb9-4054-9c61-5420c17ce80f on hv-cinder-85690 Sep 10 14:20:19.447726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-fc61827e-a3d2-4637-83cd-4a58c5d5809b req-bf84267b-2e51-4e14-b6d8-61069605caa7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Sep 10 14:20:19.448340 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 415/837] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:27.961957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:27.962514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:27.969313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:27.969788 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:27.970219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:27.970899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:27.971350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:27.971798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:28.002076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d669cbfa-e0ec-4980-949f-45ab55848ba7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments/d6dd7e44-d8bb-47a4-a84c-db5cf41630de" status: 200 len: 194 microversion: 2.20 time: 0.045169 Sep 10 14:20:28.002656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 423/838] 10.222.0.26 () {60 vars in 1454 bytes} [Sat Sep 10 14:20:27 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments/d6dd7e44-d8bb-47a4-a84c-db5cf41630de => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:20:28.072301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:28.072882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:28.074793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:28.081409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:28.081903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:28.082342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:28.083037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:28.083520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:28.083956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:28.165178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lazy-loading 'services' on Instance uuid 5c6e701d-06b7-4ca6-a202-2327ce74a974 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:20:28.236962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-853e18f4-4397-45cc-8701-2931114dd150 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments/d6dd7e44-d8bb-47a4-a84c-db5cf41630de" status: 202 len: 0 microversion: 2.20 time: 0.169278 Sep 10 14:20:28.237553 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 416/839] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Sep 10 14:20:28 2022] DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments/d6dd7e44-d8bb-47a4-a84c-db5cf41630de => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 14:20:28.247010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:28.249259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:28.255992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:28.256473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:28.256900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:28.258207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:28.258763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:28.259416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:28.291253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c2523b92-6b0b-4541-a4f5-d22efad33ff9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049229 Sep 10 14:20:28.291887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 424/840] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 10 14:20:28 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:20:29.306247 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:29.308613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:29.315400 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:29.315908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:29.316342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:29.317023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:29.317474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:29.317893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:29.348143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1ed38557-e80d-43e2-8dbb-16574cadd454 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046716 Sep 10 14:20:29.348768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 417/841] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 10 14:20:29 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:20:30.360956 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:30.363329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:30.369486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:30.369969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:30.370408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:30.371096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:30.371584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:30.372010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:30.401852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c9fc6eb5-4919-409d-82e7-cfec463c4f7a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045065 Sep 10 14:20:30.402402 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 425/842] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 10 14:20:30 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:20:30.469292 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:30.469796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:30.476257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:30.476743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:30.477180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:30.477875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:30.478330 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:30.478756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:30.505476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:20:30.520233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:30.581921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1759fe72-e0ea-4ca9-8d0a-71ea5c0a724d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 204 len: 0 microversion: 2.20 time: 0.116371 Sep 10 14:20:30.582517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 418/843] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 10 14:20:30 2022] DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 14:20:30.593799 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:30.594452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:30.600432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:30.600918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:30.601355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:30.602047 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:30.602501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:30.602926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:30.737332 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:30.745562 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:30.747010 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:30.748297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-21708e5a-eeb8-4d9a-ac5c-2cf415028d59 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.160928 Sep 10 14:20:30.748856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 426/844] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:30 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:31.775088 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:31.775739 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:31.782159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:31.782642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:31.783079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:31.783802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:31.784268 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:31.784694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:31.917964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:31.926265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:31.927744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:31.928914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-694407ad-e03b-4d97-9a05-6b95e937f08f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.158314 Sep 10 14:20:31.929473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 419/845] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:31 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:32.954645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:32.955254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:32.961698 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:32.962179 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:32.962625 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:32.963305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:32.963790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:32.964209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:33.176925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:33.185023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:33.187363 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:33.188571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-38bdeb1e-a52e-4886-b447-61847c8e2c6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1724 microversion: 2.20 time: 0.238290 Sep 10 14:20:33.189126 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 427/846] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:32 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:33.776020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-778f182e-35da-4059-88f8-9c51c5bce698 req-22a30368-97fa-440f-aad9-631ce7b269b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e701d-06b7-4ca6-a202-2327ce74a974", "name": "network-vif-deleted", "tag": "f3b631eb-8fba-46c9-b159-1cf33c2912ea"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:33.788746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-778f182e-35da-4059-88f8-9c51c5bce698 req-22a30368-97fa-440f-aad9-631ce7b269b3 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:33.789235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-778f182e-35da-4059-88f8-9c51c5bce698 req-22a30368-97fa-440f-aad9-631ce7b269b3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:33.789659 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-778f182e-35da-4059-88f8-9c51c5bce698 req-22a30368-97fa-440f-aad9-631ce7b269b3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:33.806539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-778f182e-35da-4059-88f8-9c51c5bce698 req-22a30368-97fa-440f-aad9-631ce7b269b3 service nova] Creating event network-vif-deleted:f3b631eb-8fba-46c9-b159-1cf33c2912ea for instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 on hv-cinder-85690 Sep 10 14:20:33.811871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-778f182e-35da-4059-88f8-9c51c5bce698 req-22a30368-97fa-440f-aad9-631ce7b269b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039228 Sep 10 14:20:33.812686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 420/847] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:34.214142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:34.214750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:34.221790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:34.222229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:34.222645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:34.223340 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:34.223820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:34.224242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:34.256072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:34.256550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:34.256980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:34.257426 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lazy-loading 'fault' on Instance uuid 5c6e701d-06b7-4ca6-a202-2327ce74a974 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:20:34.298737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:34.307106 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:34.308585 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:34.309745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-308a9fa4-959e-479c-af34-cd8a671f4fa0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 200 len: 1371 microversion: 2.20 time: 0.099499 Sep 10 14:20:34.310295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 428/848] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:34 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:35.337382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:35.338078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:35.344279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:35.344775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:35.345233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:35.345908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:35.346357 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:35.346771 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:35.360425 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] HTTP exception thrown: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Request method failure captured: Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 HTTP/1.1 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuehMqNV6UYXTdX_gqaVyAHpd-JUvm0WsqeFNgiOXwciLYhnpJVuEib2EZdJhOvTQVcd8tEjPJ-sxOqSUbNaUvU8EGEmSfOO1kZtCf6t81GoGuazVfZqcFv9Q5yYBuEVPw9Kv5FTdrieoghoD7Nw_ZzkXa672O904Hw81HNPpEQN64 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:20:35.362261 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d5947e3bd184558bc1a8febcedce00f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}] Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 810f0fa1f7774b37a09a91964c40b823 Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:20:35.364030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '5c6e701d-06b7-4ca6-a202-2327ce74a974'} Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:20:35.364881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:20:35.366157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:20:35.367290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Returning 404 to user: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:20:35.367290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a523a535-a261-4066-9337-4f89b4cdecfd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 404 len: 111 microversion: 2.20 time: 0.030995 Sep 10 14:20:35.367290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 421/849] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:35 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:20:35.372507 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-32126a9d-a034-4aee-9ef5-0d8e34f8aa2a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '.version_select at 0x7ff6b720f550>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:35.391938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-32126a9d-a034-4aee-9ef5-0d8e34f8aa2a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989421728" status: 204 len: 0 microversion: 2.20 time: 0.023284 Sep 10 14:20:35.392499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 429/850] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 10 14:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989421728 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 14:20:36.025603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-96616f3a-ae9d-4a00-b781-09a894028887 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'create', calling method: .version_select at 0x7ff6b6fbde50>, body: {"keypair": {"name": "tempest-keypair-901340103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyIuBDpd0t9vC5s9WNorEwcajeF2Ke1yzzXvEPWWTD1kr4Lyv6ryFug/U1NzCxHbofcVsF7FW1jt7y1PQVrz420GQqOlLrqZ1UcyizamTjOFI3diXJwaOqgGp8IOmuelg=="}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:36.041055 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-96616f3a-ae9d-4a00-b781-09a894028887 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:20:36.044966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-96616f3a-ae9d-4a00-b781-09a894028887 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for user 810f0fa1f7774b37a09a91964c40b823 and project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:20:36.066035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-96616f3a-ae9d-4a00-b781-09a894028887 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044453 Sep 10 14:20:36.066783 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 422/851] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 10 14:20:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 14:20:37.263408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1241308191", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8da15eba-048a-487b-8b2b-8df4d906800c"}], "security_groups": [{"name": "tempest-securitygroup--1546737867"}], "key_name": "tempest-keypair-901340103", "user_data": "}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:37.376836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] validate_networks() for [('8da15eba-048a-487b-8b2b-8df4d906800c', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:20:37.750315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:20:37.750742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:20:37.751267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:20:37.751716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:20:37.752129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:20:37.760841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:37.761319 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:37.761752 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:37.762481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:37.762935 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:37.763357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:37.780365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:20:37.785053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Getting quotas for user 810f0fa1f7774b37a09a91964c40b823 and project 7d5947e3bd184558bc1a8febcedce00f. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:20:37.795913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:20:37.798761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:20:37.845335 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-68b8b17d-1a10-49bf-9d64-831566680770 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.586241 Sep 10 14:20:37.846019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 430/852] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 10 14:20:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 14:20:37.857550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2045b9ca-4dfa-4714-a654-3226cb0ba6f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:37.858151 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2045b9ca-4dfa-4714-a654-3226cb0ba6f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:37.918692 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2045b9ca-4dfa-4714-a654-3226cb0ba6f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:37.926620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2045b9ca-4dfa-4714-a654-3226cb0ba6f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:37.928159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2045b9ca-4dfa-4714-a654-3226cb0ba6f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:37.929441 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2045b9ca-4dfa-4714-a654-3226cb0ba6f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1281 microversion: 2.20 time: 0.076241 Sep 10 14:20:37.929998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 423/853] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:37 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:38.955578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:38.956098 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:38.962081 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:38.962557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:38.962987 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:38.963697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:38.964144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:38.964561 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:39.028858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:39.037483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:39.038923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:39.040057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d43764c9-0114-4111-b80f-7458ead821bb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1333 microversion: 2.20 time: 0.089615 Sep 10 14:20:39.040615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 431/854] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:38 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:40.066367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:40.066987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:40.074570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:40.074992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:40.075426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:40.076930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:40.077388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:40.077878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:40.210487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:40.218613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:40.220108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:40.221287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-64c4c248-9da4-4d42-a179-a7e27f84dcc3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.158941 Sep 10 14:20:40.222110 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 424/855] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:40 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:40.529139 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-645f6400-a1ac-4b8e-b46b-21fe4145ab79 req-b8ba7223-fd8e-49dd-937e-6ce054fc2892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:40.539177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-645f6400-a1ac-4b8e-b46b-21fe4145ab79 req-b8ba7223-fd8e-49dd-937e-6ce054fc2892 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:40.539687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-645f6400-a1ac-4b8e-b46b-21fe4145ab79 req-b8ba7223-fd8e-49dd-937e-6ce054fc2892 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:40.540118 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-645f6400-a1ac-4b8e-b46b-21fe4145ab79 req-b8ba7223-fd8e-49dd-937e-6ce054fc2892 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:40.543496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=80 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:40.554980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-645f6400-a1ac-4b8e-b46b-21fe4145ab79 req-b8ba7223-fd8e-49dd-937e-6ce054fc2892 service nova] Creating event network-changed:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:20:40.559831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-645f6400-a1ac-4b8e-b46b-21fe4145ab79 req-b8ba7223-fd8e-49dd-937e-6ce054fc2892 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034330 Sep 10 14:20:40.560427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 432/856] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:41.247260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:41.248503 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:41.255963 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:41.256440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:41.256867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:41.257549 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:41.257994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:41.258410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:41.389007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:41.397384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:41.398815 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:41.399947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d03dd57b-ee5b-46c2-9125-2ce66251c8b8 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.157298 Sep 10 14:20:41.400500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 425/857] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:41 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:20:42.427008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:42.427730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:42.433981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:42.434471 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:42.434908 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:42.435624 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:42.436081 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:42.436511 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:42.566544 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:42.574528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:42.576005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:42.577105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2693a812-9f41-4199-9e0d-a492d27aeb8e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.155296 Sep 10 14:20:42.577663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 433/858] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:42 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:43.603061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:43.603712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:43.610524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:43.611000 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:43.611433 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:43.612387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:43.612835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:43.613398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:43.745487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:43.754539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:43.755995 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:43.757087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0304e6b8-89bd-4880-99d0-bd4ddb6f2d05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.158005 Sep 10 14:20:43.757639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 426/859] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:43 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:44.782916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:44.783563 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:44.785984 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:44.791061 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:44.791566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:44.792003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:44.792691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:44.793816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:44.793816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:44.928585 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:44.936825 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:44.939148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:44.940296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b7aa88c7-8c8e-4a8d-ab3d-b63acc18e2eb tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.161507 Sep 10 14:20:44.940851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 434/860] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:44 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:45.965884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:45.966501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:45.972911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:45.973402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:45.973841 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:45.974539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:45.974992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:45.975421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:46.103606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:46.112090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:46.113535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:46.114648 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8f276827-f5fd-4636-a3d7-f21e76314513 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.152822 Sep 10 14:20:46.115218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 427/861] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:45 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:47.140269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:47.140911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:47.147369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:47.147886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:47.148322 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:47.149007 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:47.149459 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:47.149882 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:47.281142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:47.289611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:47.291074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:47.292216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c547931f-d228-4ec5-bf3a-09136d907159 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.155954 Sep 10 14:20:47.292845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 435/862] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:47 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:47.371989 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-bc7aa84f-0af0-4737-9c75-f0b6754a8c47 req-20f0e514-27a0-44d3-92aa-35925fe1a160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "name": "network-vif-plugged", "status": "completed", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:47.383519 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-bc7aa84f-0af0-4737-9c75-f0b6754a8c47 req-20f0e514-27a0-44d3-92aa-35925fe1a160 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:47.384013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-bc7aa84f-0af0-4737-9c75-f0b6754a8c47 req-20f0e514-27a0-44d3-92aa-35925fe1a160 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:47.384439 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-bc7aa84f-0af0-4737-9c75-f0b6754a8c47 req-20f0e514-27a0-44d3-92aa-35925fe1a160 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:47.397740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-bc7aa84f-0af0-4737-9c75-f0b6754a8c47 req-20f0e514-27a0-44d3-92aa-35925fe1a160 service nova] Creating event network-vif-plugged:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:20:47.402887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-bc7aa84f-0af0-4737-9c75-f0b6754a8c47 req-20f0e514-27a0-44d3-92aa-35925fe1a160 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034818 Sep 10 14:20:47.403572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 428/863] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:20:48.317782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:48.318302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:48.320137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:48.320789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:48.327282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:48.327944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:48.328504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:48.329199 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:48.329655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:48.330087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:48.474445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:48.482454 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:48.484779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:48.485974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-770d87a7-759d-424f-98dc-60e8512b688f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.172247 Sep 10 14:20:48.486534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 436/864] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:48 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:49.508702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:20:49.513395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:49.514091 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:49.520418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:49.520898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:49.521330 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:49.522017 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:49.522469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:49.522890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:49.654588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:49.663268 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:49.664736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:49.665839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-83bc003f-0919-495b-8dfb-e2e6602de5f6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1407 microversion: 2.20 time: 0.158154 Sep 10 14:20:49.666398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 429/865] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:49 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:50.692747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:50.693365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:50.702366 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:50.703020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:50.703732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:50.704420 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:50.704867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:50.705295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:50.853637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:50.862676 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:50.864210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:20:50.865385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6d2730cc-091d-4527-840d-680aff99b9c0 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1600 microversion: 2.20 time: 0.177819 Sep 10 14:20:50.865953 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 437/866] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:20:50 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:20:50.890638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:20:50.891285 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:20:50.899333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:50.899915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:50.900498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:50.901207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:50.901663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:50.902089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:50.989857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5965912d-df79-4f67-a2aa-70404191ce9c tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103197 Sep 10 14:20:50.990507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 430/867] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 10 14:20:50 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:20:51.933705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-240f2acb-7763-4d16-ae0e-92ca2f53446a req-7f5bc412-3658-4cf4-8a96-f70e522598db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:20:51.943663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-240f2acb-7763-4d16-ae0e-92ca2f53446a req-7f5bc412-3658-4cf4-8a96-f70e522598db service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:20:51.944140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-240f2acb-7763-4d16-ae0e-92ca2f53446a req-7f5bc412-3658-4cf4-8a96-f70e522598db service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:20:51.944569 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-240f2acb-7763-4d16-ae0e-92ca2f53446a req-7f5bc412-3658-4cf4-8a96-f70e522598db service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:20:51.955802 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-240f2acb-7763-4d16-ae0e-92ca2f53446a req-7f5bc412-3658-4cf4-8a96-f70e522598db service nova] Creating event network-changed:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:20:51.960848 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-240f2acb-7763-4d16-ae0e-92ca2f53446a req-7f5bc412-3658-4cf4-8a96-f70e522598db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031011 Sep 10 14:20:51.961763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 438/868] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:02.250052 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:02.250813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:02.255148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:02.257347 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:02.265002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:02.265478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:02.265904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:02.266588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:02.267037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:02.267470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:02.340480 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ff400b4a-c255-447c-bd6c-62eca49ea229 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/action" status: 202 len: 0 microversion: 2.1 time: 0.092170 Sep 10 14:21:02.341093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 431/869] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:21:02 2022] POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:02.347641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=9 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:02.348931 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=33 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:02.353301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:02.354003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:02.362306 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:02.362776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:02.363208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:02.363925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:02.364374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:02.364789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:02.599181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:02.607683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-383884ef-7e0b-4a97-a54e-0f003a815924 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1752 microversion: 2.1 time: 0.262025 Sep 10 14:21:02.608264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 439/870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:02 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1752 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:03.634455 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:03.635158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:03.642051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:03.642471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:03.642904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:03.643619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:03.644073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:03.644501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:03.786909 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:03.795016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f1cf252e-43d1-471e-8939-c47e4d11ecda tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.165450 Sep 10 14:21:03.795610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 432/871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:03 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:04.819087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:04.819717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:04.826140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:04.826615 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:04.827047 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:04.828819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:04.829272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:04.829694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:04.973083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:04.981259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-741cb6dc-25f8-4a99-a82d-f199628998dd tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.166009 Sep 10 14:21:04.981827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 440/872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:04 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:06.005134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:06.005753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:06.012250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:06.012736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:06.013171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:06.013859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:06.014318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:06.014808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:06.157415 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:06.165565 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-850152d9-1f59-4e49-9934-c20b47c9bcec tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.164320 Sep 10 14:21:06.166123 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 433/873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:05 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:07.188837 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:07.189443 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:07.195863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:07.196337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:07.196800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:07.197477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:07.197926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:07.198346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:07.339992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:07.348951 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4d8ff729-56a0-4bc9-89af-1d92e4267c95 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.164508 Sep 10 14:21:07.349511 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 441/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:07 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:08.372450 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:08.373062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:08.379639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:08.380145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:08.380563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:08.381252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:08.381703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:08.382126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:08.523915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:08.532374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-811f6cb3-7fe2-45e0-b839-b047a5fb5f16 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.163843 Sep 10 14:21:08.532931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 434/875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:08 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:09.555806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:09.556421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:09.563421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:09.563929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:09.564362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:09.565484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:09.565484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:09.565899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:09.706232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:09.714907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b11757ff-bed5-4c2e-944b-efcaefaba802 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.163045 Sep 10 14:21:09.715504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 442/876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:09 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:10.739580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:10.740194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:10.746564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:10.747048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:10.747507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:10.748202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:10.748659 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:10.749081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:10.890086 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:10.898956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ab8c46b8-f3d5-4b81-816d-36c8ff448437 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.163518 Sep 10 14:21:10.899744 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 435/877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:10 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:11.924239 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:11.924868 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:11.931219 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:11.931737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:11.932176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:11.932863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:11.933321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:11.933745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:12.076871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:12.085635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-64d767a7-5cc0-4f6b-b382-d67ab1e20af2 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.165769 Sep 10 14:21:12.086212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 443/878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:11 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:13.109706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:13.110488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:13.116758 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:13.117237 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:13.117664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:13.118342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:13.118788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:13.119204 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:13.258837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:13.267720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f9ba7f7f-c32c-4411-a8ee-7db622908fdf tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.162195 Sep 10 14:21:13.268477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 436/879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:13 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:14.290584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:14.291197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:14.298418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:14.298899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:14.299329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:14.300036 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:14.300487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:14.300906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:14.448597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:14.457028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9ba429f7-4037-4e9d-9358-49d83cff45b1 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1757 microversion: 2.1 time: 0.170289 Sep 10 14:21:14.457598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 444/880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:14 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:15.480238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:15.480849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:15.488420 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:15.488898 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:15.489327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:15.490002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:15.490450 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:15.490867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:15.631238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:15.639409 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6416f381-0022-4df0-9791-286e604681cb tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1760 microversion: 2.1 time: 0.163081 Sep 10 14:21:15.640352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 437/881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:15 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:16.171021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:16.171584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:16.178707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:16.179193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:16.179681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:16.180376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:16.180840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:16.181264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:16.264611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'services' on Instance uuid 9ae4dfd1-21db-43b2-82d4-6810bbec230c {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:21:16.335702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ad7023b4-fe42-443f-8f37-621e6ea6c2a5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments/002587c6-4ccb-4928-b3ca-b5947f783cdc" status: 202 len: 0 microversion: 2.1 time: 0.168386 Sep 10 14:21:16.336353 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 445/882] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:21:16 2022] DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments/002587c6-4ccb-4928-b3ca-b5947f783cdc => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:16.345467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:16.347867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:16.354111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:16.354630 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:16.355174 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:16.355916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:16.356382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:16.356813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:16.387076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-adb36594-ee04-4236-9d44-0df716933caf tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046185 Sep 10 14:21:16.387579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 438/883] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:21:16 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:17.402680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:17.405035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:17.412109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:17.412591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:17.413019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:17.413702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:17.414171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:17.414609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:17.447031 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-35822645-3f30-4c35-a1e4-b7c815b39210 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050067 Sep 10 14:21:17.447614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 446/884] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:21:17 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:21:17.527976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:17.528530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:17.535012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:17.535530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:17.535970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:17.536660 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:17.537112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:17.537740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:17.562866 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:21:17.637332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-68e6db0f-8f28-4a27-9da7-88ca11babd97 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 204 len: 0 microversion: 2.1 time: 0.112657 Sep 10 14:21:17.638779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 439/885] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:21:17 2022] DELETE /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:21:17.647523 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:17.648201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:17.654102 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:17.654525 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:17.654961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:17.655701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:17.656193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:17.656707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:17.790257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:17.799112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4f0d7bb3-e733-4ec2-868d-fec93dfc6f96 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1690 microversion: 2.1 time: 0.155449 Sep 10 14:21:17.799756 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 447/886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:17 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:18.709897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:18.712216 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:18.719532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.720027 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.720471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.721173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.721626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.722054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.750883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e7803bc9-1dee-46ce-8e55-01b89b18a5c1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045213 Sep 10 14:21:18.751686 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 440/887] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:21:18 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:21:18.814139 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:18.814632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:18.821042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.821526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.821793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:18.822006 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.822418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:18.822623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.823071 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.823524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.828401 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.828896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.829338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.830040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.830500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.830931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.849189 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:21:18.927251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1101991e-8012-4379-acca-a6cf6422174d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 204 len: 0 microversion: 2.1 time: 0.117105 Sep 10 14:21:18.927803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 448/888] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:21:18 2022] DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:21:18.936536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:18.937288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:18.943150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.943680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.944124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.944827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:18.945285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:18.945710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:18.968372 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:18.976982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-727332f5-4452-4888-a319-9581a678c41c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1690 microversion: 2.1 time: 0.158947 Sep 10 14:21:18.977580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 441/889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:18 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:19.075005 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:19.082871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1253685d-c360-4dd7-90f7-e0a20c84d3e4 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1673 microversion: 2.1 time: 0.150347 Sep 10 14:21:19.083431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 449/890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:18 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:20.001220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:20.001834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:20.008247 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:20.008731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:20.009164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:20.009849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:20.010301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:20.010726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:20.106364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:20.107079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:20.114566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:20.115049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:20.115501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:20.116491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:20.116982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:20.117405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:20.138657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:20.146808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d83e4410-2f7f-4e98-b725-6b85522dbc79 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1690 microversion: 2.1 time: 0.150119 Sep 10 14:21:20.147373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 442/891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:19 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:20.247373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:20.255080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d11ce62b-fbc8-4bf9-8b1b-cd0cb5b7c101 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1673 microversion: 2.1 time: 0.152905 Sep 10 14:21:20.255670 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 450/892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:20 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:21.169883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:21.170497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:21.177031 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:21.177518 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:21.177957 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:21.178651 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:21.179109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:21.179569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:21.278153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:21.278964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:21.285796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:21.286355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:21.286857 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:21.287573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:21.288023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:21.288441 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:21.309037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:21.317404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b8a408f7-9501-473c-98eb-c06de2e36d3c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1690 microversion: 2.1 time: 0.151407 Sep 10 14:21:21.317966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 443/893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:21 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:21.418975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:21.426738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d7ca6438-eb7d-4f0c-af01-9783e236ab1f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1673 microversion: 2.1 time: 0.152384 Sep 10 14:21:21.427246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 451/894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:21 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:22.340413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:22.341024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:22.348182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:22.348678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:22.349100 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:22.349787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:22.350246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:22.350669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:22.452091 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:22.452711 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:22.460166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:22.460654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:22.461090 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:22.461786 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:22.462241 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:22.462659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:22.481935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:22.485899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:22.492081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f636c249-30ff-453d-948b-97301effec10 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1690 microversion: 2.1 time: 0.155463 Sep 10 14:21:22.492861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 444/895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:22 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:22.633796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:22.641520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a1b9df3e-f1be-4b49-9e3b-7bb7ffa17fc1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1673 microversion: 2.1 time: 0.193349 Sep 10 14:21:22.642083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 452/896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:22 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:23.511746 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-178cd370-c950-4dca-98d3-07604e087ca6 req-831b1cec-d70d-4493-b6eb-070ff7835707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d02053b-770b-4632-bbb2-f8867cb62341", "name": "network-vif-deleted", "tag": "1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:23.517043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:23.517655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:23.525335 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-178cd370-c950-4dca-98d3-07604e087ca6 req-831b1cec-d70d-4493-b6eb-070ff7835707 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.526145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-178cd370-c950-4dca-98d3-07604e087ca6 req-831b1cec-d70d-4493-b6eb-070ff7835707 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.526793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-178cd370-c950-4dca-98d3-07604e087ca6 req-831b1cec-d70d-4493-b6eb-070ff7835707 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.540351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-178cd370-c950-4dca-98d3-07604e087ca6 req-831b1cec-d70d-4493-b6eb-070ff7835707 service nova] Creating event network-vif-deleted:1b1a45e2-9fb0-4fa6-9b16-8a112e639e2e for instance 4d02053b-770b-4632-bbb2-f8867cb62341 on hv-cinder-85690 Sep 10 14:21:23.546251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-178cd370-c950-4dca-98d3-07604e087ca6 req-831b1cec-d70d-4493-b6eb-070ff7835707 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038131 Sep 10 14:21:23.546537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.547480 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.548508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 445/897] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:23.548924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.550707 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.551494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.552784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.561050 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:23.651089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:23.665978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:23.666794 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:23.669585 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-76b27073-4a67-4314-b49c-1091a6dec65a tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1622 microversion: 2.1 time: 0.158023 Sep 10 14:21:23.677615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.684195 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.684900 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.685644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.686108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.686530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.688579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 453/898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:23 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1622 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:23.725219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.726051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.726762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.727831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lazy-loading 'fault' on Instance uuid 4d02053b-770b-4632-bbb2-f8867cb62341 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:21:23.836669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:23.847117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a88d3eb7-6003-4820-a420-4508887f77ad tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 200 len: 1328 microversion: 2.1 time: 0.185614 Sep 10 14:21:23.864500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 446/899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:23 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:23.876981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-0cfda845-b224-4296-bddd-f529f93917cf req-1f43314c-cc92-414d-b1bd-3562418ef0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae4dfd1-21db-43b2-82d4-6810bbec230c", "name": "network-vif-deleted", "tag": "9f9f16ce-e5be-47d7-aaea-0c62e3b54548"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:23.888359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0cfda845-b224-4296-bddd-f529f93917cf req-1f43314c-cc92-414d-b1bd-3562418ef0ed service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:23.889268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0cfda845-b224-4296-bddd-f529f93917cf req-1f43314c-cc92-414d-b1bd-3562418ef0ed service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:23.889972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-0cfda845-b224-4296-bddd-f529f93917cf req-1f43314c-cc92-414d-b1bd-3562418ef0ed service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:23.917903 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-0cfda845-b224-4296-bddd-f529f93917cf req-1f43314c-cc92-414d-b1bd-3562418ef0ed service nova] Creating event network-vif-deleted:9f9f16ce-e5be-47d7-aaea-0c62e3b54548 for instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c on hv-cinder-85690 Sep 10 14:21:23.925315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-0cfda845-b224-4296-bddd-f529f93917cf req-1f43314c-cc92-414d-b1bd-3562418ef0ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054054 Sep 10 14:21:23.926515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 454/900] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:24.694515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:24.695224 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:24.701619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:24.702119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:24.702562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:24.704139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:24.704606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:24.705034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:24.739798 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:24.740328 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:24.740821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:24.741278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'fault' on Instance uuid 9ae4dfd1-21db-43b2-82d4-6810bbec230c {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:21:24.790890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:24.798795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-27d16f8e-2669-4d8a-8425-eaad76c195b5 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 200 len: 1336 microversion: 2.1 time: 0.108072 Sep 10 14:21:24.799358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 447/901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:24 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:24.873492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:24.874212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:24.880941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:24.881428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:24.881859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:24.882545 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:24.882994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:24.883406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:24.898141 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] HTTP exception thrown: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Request method failure captured: Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 HTTP/1.1 Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJubRWGlkrvtD7Ta-J58bVaOrm-ZZ8G5d_nJMmyQBdhYoXC2X-eHrUkPcExLsrtymiJsu2fa_mHEYJIq-WysL5W76ortlPWvbtcVUDHTUSnzQyKf97KF1fm2IutmhZjqkw4QrfXMYmkQqB_ngca1jEg3l4O5qediTWpzKB0Vtbd-8g0 Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:21:24.900223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6efda1ce3d4d4dbbb5e8d5005902924d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}] Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 8ea8ba61dfa54cbc9a45543d20f31e76 Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:21:24.902132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '4d02053b-770b-4632-bbb2-f8867cb62341'} Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:24.903188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:21:24.904528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:24.905705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Returning 404 to user: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:24.905705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3007104c-1ce6-4db3-8130-125f167e64d1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 404 len: 111 microversion: 2.1 time: 0.033217 Sep 10 14:21:24.905705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 455/902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:24 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:21:24.913498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a88dcd4b-54df-42f3-a87e-acac94b5d60d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '.version_select at 0x7ff6b6fcfee0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:24.935616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a88dcd4b-54df-42f3-a87e-acac94b5d60d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717512150" status: 202 len: 0 microversion: 2.1 time: 0.026045 Sep 10 14:21:24.936330 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 448/903] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 10 14:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717512150 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:25.590748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bbd037b8-c890-44f3-b7c8-40d7a9855345 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: .version_select at 0x7ff6b719e8b0>, body: {"keypair": {"name": "tempest-keypair-749036354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNitJgCrxfb6LcZwjufpHpfEyp0BFota/kfMLCf9kMCHS1DzUjGhTjH/VXBFEu5tkq+chGXSb0iNwBDeM5De7QRZWeFKijtMwF50jXHiYGWl3P5sghwsexWa9EKr0LCy3Q=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:25.605589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-bbd037b8-c890-44f3-b7c8-40d7a9855345 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:21:25.610304 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-bbd037b8-c890-44f3-b7c8-40d7a9855345 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for user 8ea8ba61dfa54cbc9a45543d20f31e76 and project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:21:25.632494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bbd037b8-c890-44f3-b7c8-40d7a9855345 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045652 Sep 10 14:21:25.633071 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 456/904] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:21:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:25.821301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:25.822003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 9ae4dfd1-21db-43b2-82d4-6810bbec230c] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:25.827913 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:25.828403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:25.828839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:25.829536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:25.829997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:25.830422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:25.844499 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] HTTP exception thrown: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c could not be found. Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Request method failure captured: Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c HTTP/1.1 Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuenlU242EO7D9nGmkG2doxdtT7aJBj_Zl81ZveG_OE1klgLXgfGbihLt-R8I2sCIMgegEp508v6l6nAAjcinvEzoh6InkSTUTNViKY96J74c27QLyEQITMfBToMi13MUCV8sgc-SEf8IJjYvnYtZLoleQaKt_3VrYS-qWNk7AF7iY Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:21:25.846300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cffd972dec364c89bbc04fd078dc7fd9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}] Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8f96c9a2a49047b5b8abd3b2c1475a18 Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c could not be found. Sep 10 14:21:25.847694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '9ae4dfd1-21db-43b2-82d4-6810bbec230c'} Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c could not be found. Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:25.848478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c could not be found. Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c could not be found. Sep 10 14:21:25.849687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:25.850818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Returning 404 to user: Instance 9ae4dfd1-21db-43b2-82d4-6810bbec230c could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:25.850818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b067f1f8-5062-4941-8e75-d77af6f92580 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c" status: 404 len: 111 microversion: 2.1 time: 0.030898 Sep 10 14:21:25.850818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 449/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:25 2022] GET /compute/v2.1/servers/9ae4dfd1-21db-43b2-82d4-6810bbec230c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:21:25.856768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d1aa4fd4-8a10-485f-b98e-7bb8938a8f87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '.version_select at 0x7ff6b7271b80>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:25.877918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d1aa4fd4-8a10-485f-b98e-7bb8938a8f87 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080881406" status: 202 len: 0 microversion: 2.1 time: 0.024691 Sep 10 14:21:25.881883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 457/906] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 10 14:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080881406 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:26.906431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-276638072", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0530a74-5c63-47f6-82f4-eebc1378a61a"}], "security_groups": [{"name": "tempest-securitygroup--2028108147"}], "key_name": "tempest-keypair-749036354", "user_data": "}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:27.018850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] validate_networks() for [('e0530a74-5c63-47f6-82f4-eebc1378a61a', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:21:27.643824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:21:27.644319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:21:27.644865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:21:27.645283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:21:27.645724 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:21:27.654698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:27.655184 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:27.655673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:27.656714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:27.657180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:27.657602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:27.675840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:21:27.679960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Getting quotas for user 8ea8ba61dfa54cbc9a45543d20f31e76 and project 6efda1ce3d4d4dbbb5e8d5005902924d. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:21:27.693174 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:21:27.695516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:21:27.751616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6cdaa213-1564-4ea2-a79f-f37dedca784b tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850853 Sep 10 14:21:27.752398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 450/907] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:21:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:21:27.763757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-78107225-4bda-49de-a89b-d2c12bbf2bb1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:27.764935 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-78107225-4bda-49de-a89b-d2c12bbf2bb1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:27.822570 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-78107225-4bda-49de-a89b-d2c12bbf2bb1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:27.829936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-78107225-4bda-49de-a89b-d2c12bbf2bb1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1236 microversion: 2.1 time: 0.070570 Sep 10 14:21:27.830494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 458/908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:27 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:28.779346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:28.779866 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:28.786662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:28.787148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:28.787625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:28.788342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:28.788797 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:28.789221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:28.813982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:21:28.852927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:28.853636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:28.860263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:28.860766 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:28.861192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:28.861889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:28.862349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:28.863037 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:28.889475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-82f1098d-f103-405d-834e-77070f720e90 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 204 len: 0 microversion: 2.1 time: 0.114191 Sep 10 14:21:28.893945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 451/909] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:21:28 2022] DELETE /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:21:28.899471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:28.900270 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:28.906180 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:28.906690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:28.907127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:28.907859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:28.908314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:28.908737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:28.943140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:28.951256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-aca0017a-db4d-4dbe-a056-440b5000f23e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1288 microversion: 2.1 time: 0.102043 Sep 10 14:21:28.951934 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 459/910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:28 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:29.044613 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:29.052949 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5b99e781-2e10-47be-a877-62e272b5e9c2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1508 microversion: 2.1 time: 0.157752 Sep 10 14:21:29.053511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 452/911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:28 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:29.975839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:29.976539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:29.983123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:29.984416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:29.985001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:29.985724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:29.986182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:29.986607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:30.076427 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:30.077040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:30.085339 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:30.085837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:30.086545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:30.087510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:30.088167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:30.088849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:30.235125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:30.245383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-130d70ce-7fc9-4a59-b297-7244b92ee53f tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.273544 Sep 10 14:21:30.259468 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 460/912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:29 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:30.298390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:30.310032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-de7535aa-f962-47cc-86c9-61394a4a70db tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1508 microversion: 2.1 time: 0.235927 Sep 10 14:21:30.310966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 453/913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:30 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:30.453440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-4b36598d-c40c-4f12-8f5b-2c912eeb4dd0 req-5824296e-ae5d-44f6-ab1c-1e5d05cc6ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2854a3-80bf-4f48-b3ac-bd7da137ed28", "name": "network-vif-deleted", "tag": "b57abb22-a3a4-4796-a68e-0be41a2d509d"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:30.463856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-4b36598d-c40c-4f12-8f5b-2c912eeb4dd0 req-5824296e-ae5d-44f6-ab1c-1e5d05cc6ce2 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:30.464341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-4b36598d-c40c-4f12-8f5b-2c912eeb4dd0 req-5824296e-ae5d-44f6-ab1c-1e5d05cc6ce2 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:30.464775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-4b36598d-c40c-4f12-8f5b-2c912eeb4dd0 req-5824296e-ae5d-44f6-ab1c-1e5d05cc6ce2 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:30.476797 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-4b36598d-c40c-4f12-8f5b-2c912eeb4dd0 req-5824296e-ae5d-44f6-ab1c-1e5d05cc6ce2 service nova] Creating event network-vif-deleted:b57abb22-a3a4-4796-a68e-0be41a2d509d for instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 on hv-cinder-85690 Sep 10 14:21:30.482043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-4b36598d-c40c-4f12-8f5b-2c912eeb4dd0 req-5824296e-ae5d-44f6-ab1c-1e5d05cc6ce2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Sep 10 14:21:30.485892 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 461/914] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:30.983020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-0963a00f-e71e-4cae-a885-aeefdc835eab req-a0b87167-d384-4018-8f54-f03485eb80cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4453e93-3061-4fe5-a24d-a9c6c963aa90", "tag": "f194f0b8-fc5a-434c-8501-9524a54a8e34"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:30.992722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-0963a00f-e71e-4cae-a885-aeefdc835eab req-a0b87167-d384-4018-8f54-f03485eb80cd service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:30.993201 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-0963a00f-e71e-4cae-a885-aeefdc835eab req-a0b87167-d384-4018-8f54-f03485eb80cd service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:30.993677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-0963a00f-e71e-4cae-a885-aeefdc835eab req-a0b87167-d384-4018-8f54-f03485eb80cd service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:31.005111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-0963a00f-e71e-4cae-a885-aeefdc835eab req-a0b87167-d384-4018-8f54-f03485eb80cd service nova] Creating event network-changed:f194f0b8-fc5a-434c-8501-9524a54a8e34 for instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 on hv-cinder-85690 Sep 10 14:21:31.009878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-0963a00f-e71e-4cae-a885-aeefdc835eab req-a0b87167-d384-4018-8f54-f03485eb80cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030753 Sep 10 14:21:31.010463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 454/915] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:31.272018 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:31.273350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:31.280392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:31.281515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:31.282481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:31.283704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:31.284626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:31.285220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:31.334672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:31.335416 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:31.342114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:31.342735 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:31.343828 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:31.344555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:31.345014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:31.345445 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:31.383163 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:31.383714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:31.384135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:31.384612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'fault' on Instance uuid 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:21:31.441102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:31.448968 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1c3cd639-4304-4073-acef-f0d4584f8082 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 200 len: 1312 microversion: 2.1 time: 0.119136 Sep 10 14:21:31.449644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 455/916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:31 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:31.507817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:31.515782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-395fdfb5-a9dd-4e04-901f-27220ba9e30d tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.248442 Sep 10 14:21:31.516273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 462/917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:31 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:32.473036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:32.473688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 3d2854a3-80bf-4f48-b3ac-bd7da137ed28] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:32.476115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:32.481345 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.481836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.482277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.482972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.483432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.483954 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.499177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] HTTP exception thrown: Instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 could not be found. Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Request method failure captured: Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 HTTP/1.1 Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuenlU242EO7D9nGmkG2doxdtT7aJBj_Zl81ZveG_OE1klgLXgfGbihLt-R8I2sCIMgegEp508v6l6nAAjcinvEzoh6InkSTUTNViKY96J74c27QLyEQITMfBToMi13MUCV8sgc-SEf8IJjYvnYtZLoleQaKt_3VrYS-qWNk7AF7iY Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:21:32.501408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cffd972dec364c89bbc04fd078dc7fd9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}] Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8f96c9a2a49047b5b8abd3b2c1475a18 Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 could not be found. Sep 10 14:21:32.502946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '3d2854a3-80bf-4f48-b3ac-bd7da137ed28'} Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 could not be found. Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:32.503852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 could not be found. Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 could not be found. Sep 10 14:21:32.505054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:32.506112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Returning 404 to user: Instance 3d2854a3-80bf-4f48-b3ac-bd7da137ed28 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:32.506112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f7ab5eea-d1b6-431b-9b30-8471aaedd1b2 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28" status: 404 len: 111 microversion: 2.1 time: 0.033915 Sep 10 14:21:32.506112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 456/918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:32 2022] GET /compute/v2.1/servers/3d2854a3-80bf-4f48-b3ac-bd7da137ed28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:21:32.511154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:32.512217 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:32.514623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:32.521143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.521633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.522068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.522762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.523214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.523663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.538002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:32.538618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:32.545275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.545769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.546203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.547202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.547696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.548124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.552494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:21:32.630362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a06b839f-e34d-404a-a71a-3378fec59d4d tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 204 len: 0 microversion: 2.1 time: 0.122632 Sep 10 14:21:32.630936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 463/919] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:21:32 2022] DELETE /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:21:32.638990 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:32.639715 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:32.647861 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.648458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.648905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.649612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:32.650072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:32.650514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:32.683765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:32.692598 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c5ab69a0-1f61-401f-87ee-2ce669f17661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.158404 Sep 10 14:21:32.693161 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 457/920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:32 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:32.784846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:32.792410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6a04d225-d0a3-4f3e-a1c3-7fb8204d0568 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.157372 Sep 10 14:21:32.792971 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 464/921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:32 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:33.715731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:33.716358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:33.723332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:33.723855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:33.724283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:33.724966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:33.725412 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:33.725830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:33.816041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:33.816765 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:33.823302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:33.824025 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:33.824472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:33.825174 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:33.825629 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:33.826052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:33.859671 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:33.867603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-80ef2ffc-a0e9-4c45-9468-0c206d73e143 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.155632 Sep 10 14:21:33.868177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 458/922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:33 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:33.959879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:33.967747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d310001e-07a2-4107-86ed-73bb1f431d2c tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.155491 Sep 10 14:21:33.968291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 465/923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:33 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:34.889496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:34.890109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:34.897438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:34.897918 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:34.898381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:34.899116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:34.899821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:34.900307 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:34.991125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:34.991865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:34.998566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:34.999053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:34.999520 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:35.000300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:35.001543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:35.002443 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:35.036054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:35.043694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e1a6ab90-7a69-4a5f-8416-3236603b62a0 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.158004 Sep 10 14:21:35.044266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 459/924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:34 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:35.136668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:35.144654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-430ed859-7ab9-4490-8620-9b4cfb94f18e tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1521 microversion: 2.1 time: 0.157572 Sep 10 14:21:35.145224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 466/925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:34 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:35.947927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-b2b1c8fc-506f-4512-9b7c-a8a456bbca0a req-4b4a2375-adfb-4213-a842-1cecf280d7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1b2a0b-e748-4e8f-aa8b-ea9ded131152", "name": "network-vif-deleted", "tag": "7a0a5b67-06da-47fc-8dba-8dd6bdde132d"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:35.962236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-b2b1c8fc-506f-4512-9b7c-a8a456bbca0a req-4b4a2375-adfb-4213-a842-1cecf280d7da service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:35.962718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-b2b1c8fc-506f-4512-9b7c-a8a456bbca0a req-4b4a2375-adfb-4213-a842-1cecf280d7da service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:35.963147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-b2b1c8fc-506f-4512-9b7c-a8a456bbca0a req-4b4a2375-adfb-4213-a842-1cecf280d7da service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:35.976294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-b2b1c8fc-506f-4512-9b7c-a8a456bbca0a req-4b4a2375-adfb-4213-a842-1cecf280d7da service nova] Creating event network-vif-deleted:7a0a5b67-06da-47fc-8dba-8dd6bdde132d for instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 on hv-cinder-85690 Sep 10 14:21:35.983784 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-b2b1c8fc-506f-4512-9b7c-a8a456bbca0a req-4b4a2375-adfb-4213-a842-1cecf280d7da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038601 Sep 10 14:21:35.985153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 460/926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:36.067129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:36.067814 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:36.074416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:36.074908 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:36.075362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:36.076089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:36.076549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:36.076976 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:36.171323 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:36.172431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:36.180355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:36.181160 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:36.181832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:36.182826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:36.183511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:36.183939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:36.223661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:36.223905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:36.224147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:36.224580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:36.225186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lazy-loading 'fault' on Instance uuid 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:21:36.252612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-723085b8-acf0-4f25-8cdb-b59332a4d137 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.189461 Sep 10 14:21:36.256574 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 467/927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:36 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:21:36.270134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f96c9a2a49047b5b8abd3b2c1475a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd972dec364c89bbc04fd078dc7fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:36.279601 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0730ea5f-9cd8-4965-9a71-3e6db6906895 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 200 len: 1312 microversion: 2.1 time: 0.114246 Sep 10 14:21:36.280338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 461/928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:36 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:37.278103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:37.278712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:37.285781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:37.286271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:37.286708 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:37.287392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:37.287873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:37.288297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:37.303282 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:37.303930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] [instance: 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:37.310309 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:37.310791 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:37.311225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:37.311941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:37.312398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:37.312819 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:37.326159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] HTTP exception thrown: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 could not be found. Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Request method failure captured: Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 HTTP/1.1 Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuenlU242EO7D9nGmkG2doxdtT7aJBj_Zl81ZveG_OE1klgLXgfGbihLt-R8I2sCIMgegEp508v6l6nAAjcinvEzoh6InkSTUTNViKY96J74c27QLyEQITMfBToMi13MUCV8sgc-SEf8IJjYvnYtZLoleQaKt_3VrYS-qWNk7AF7iY Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:21:37.327830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cffd972dec364c89bbc04fd078dc7fd9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cffd972dec364c89bbc04fd078dc7fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cffd972dec364c89bbc04fd078dc7fd9"}]}] Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: cffd972dec364c89bbc04fd078dc7fd9 Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610811579 Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8f96c9a2a49047b5b8abd3b2c1475a18 Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610811579-project Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 could not be found. Sep 10 14:21:37.330090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '0d1b2a0b-e748-4e8f-aa8b-ea9ded131152'} Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 could not be found. Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:37.330859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 could not be found. Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 could not be found. Sep 10 14:21:37.332387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:37.333669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] Returning 404 to user: Instance 0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:37.333669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-234d3a19-86e4-43de-ab1c-d9b3454399f7 tempest-ServerRescueNegativeTestJSON-610811579 tempest-ServerRescueNegativeTestJSON-610811579-project] 10.222.0.26 "GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152" status: 404 len: 111 microversion: 2.1 time: 0.030277 Sep 10 14:21:37.333669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 462/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:37 2022] GET /compute/v2.1/servers/0d1b2a0b-e748-4e8f-aa8b-ea9ded131152 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 14:21:37.420986 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:37.430317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8174d4d4-5cf3-480b-a67f-50d6c992cb23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.155662 Sep 10 14:21:37.430909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 468/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:37 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:37.613004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-c30864de-185e-4e13-9d59-c780202b32dc req-d64edfa8-de9e-4571-8a81-93e1a5dc7856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4453e93-3061-4fe5-a24d-a9c6c963aa90", "name": "network-vif-plugged", "status": "completed", "tag": "f194f0b8-fc5a-434c-8501-9524a54a8e34"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:37.623848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-c30864de-185e-4e13-9d59-c780202b32dc req-d64edfa8-de9e-4571-8a81-93e1a5dc7856 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:37.624452 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-c30864de-185e-4e13-9d59-c780202b32dc req-d64edfa8-de9e-4571-8a81-93e1a5dc7856 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:37.625016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-c30864de-185e-4e13-9d59-c780202b32dc req-d64edfa8-de9e-4571-8a81-93e1a5dc7856 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:37.637725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-c30864de-185e-4e13-9d59-c780202b32dc req-d64edfa8-de9e-4571-8a81-93e1a5dc7856 service nova] Creating event network-vif-plugged:f194f0b8-fc5a-434c-8501-9524a54a8e34 for instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 on hv-cinder-85690 Sep 10 14:21:37.643277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-c30864de-185e-4e13-9d59-c780202b32dc req-d64edfa8-de9e-4571-8a81-93e1a5dc7856 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 Sep 10 14:21:37.644306 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 463/931] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:38.455302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:38.456680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:38.458739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:38.465012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:38.465514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:38.465959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:38.466670 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:38.467130 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:38.471694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:38.615856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:38.623614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a39a02fb-9a6f-4a32-8bc5-7974db594ce8 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1362 microversion: 2.1 time: 0.174113 Sep 10 14:21:38.624044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 469/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:38 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:39.643966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:39.644781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:39.649650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:39.650390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:39.657814 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:39.658303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:39.658743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:39.659463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:39.659917 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:39.660341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:39.892994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:39.896755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:39.913689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4934ecdd-b36b-4ed1-95d9-a4e71d1a9ada tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1549 microversion: 2.1 time: 0.270677 Sep 10 14:21:39.914253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 464/933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:39 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1549 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:21:39.937232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:39.937810 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:39.944137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:39.944620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:39.945056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:39.945745 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:39.946202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:39.946623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:40.034233 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-09cb1895-48d7-4025-85e7-38519da15a18 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100083 Sep 10 14:21:40.034913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 470/934] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:21:39 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:41.425479 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-26ccdfce-b449-4dc9-bfc4-8b3aed493617 req-938cfd84-983b-41e6-93f2-b89ea249e075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4453e93-3061-4fe5-a24d-a9c6c963aa90", "tag": "f194f0b8-fc5a-434c-8501-9524a54a8e34"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:41.437031 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-26ccdfce-b449-4dc9-bfc4-8b3aed493617 req-938cfd84-983b-41e6-93f2-b89ea249e075 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:41.437758 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-26ccdfce-b449-4dc9-bfc4-8b3aed493617 req-938cfd84-983b-41e6-93f2-b89ea249e075 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:41.439085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-26ccdfce-b449-4dc9-bfc4-8b3aed493617 req-938cfd84-983b-41e6-93f2-b89ea249e075 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:41.455203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-26ccdfce-b449-4dc9-bfc4-8b3aed493617 req-938cfd84-983b-41e6-93f2-b89ea249e075 service nova] Creating event network-changed:f194f0b8-fc5a-434c-8501-9524a54a8e34 for instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 on hv-cinder-85690 Sep 10 14:21:41.460986 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-26ccdfce-b449-4dc9-bfc4-8b3aed493617 req-938cfd84-983b-41e6-93f2-b89ea249e075 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040591 Sep 10 14:21:41.461873 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 465/935] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:42.440080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1b4a9347-0cd7-453f-a0eb-195f7353de6d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Action: 'create', calling method: .version_select at 0x7ff6b721f820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1633192468"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:42.758409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1b4a9347-0cd7-453f-a0eb-195f7353de6d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.469980 Sep 10 14:21:42.759230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 471/936] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Sep 10 14:21:42 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 472 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 14:21:42.786107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5f2c89ea-87c1-4814-b9ae-7f5592b024d2 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b72a8280>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:42.847538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5f2c89ea-87c1-4814-b9ae-7f5592b024d2 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 200 len: 345 microversion: 2.1 time: 0.078051 Sep 10 14:21:42.849360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 466/937] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:21:42 2022] GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:43.864390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b41d51f1-ca7d-454c-bff5-134fb0adfc58 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6ba87c5e0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:43.915214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b41d51f1-ca7d-454c-bff5-134fb0adfc58 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 200 len: 346 microversion: 2.1 time: 0.055494 Sep 10 14:21:43.915929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 472/938] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:21:43 2022] GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:43.929605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e13c2590-1f00-4fb0-87cf-3d642ad09328 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Action: 'create', calling method: .version_select at 0x7ff6b6fe3ee0>, body: {"snapshot": {"volume_id": "6bf8d12d-79f7-4a82-8ce3-6ffa515e149f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-134239679"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:44.076518 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e13c2590-1f00-4fb0-87cf-3d642ad09328 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.151186 Sep 10 14:21:44.077286 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 467/939] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Sep 10 14:21:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:21:44.088502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5330a86c-b7e4-4c7e-b46f-0c20c1d93fd6 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b7206ee0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:44.121371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5330a86c-b7e4-4c7e-b46f-0c20c1d93fd6 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.037007 Sep 10 14:21:44.121942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 473/940] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:44 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:44.133591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7b4e7e91-a2a5-4f0f-b2a6-1fc89d7ce022 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fd8b80>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:44.164059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7b4e7e91-a2a5-4f0f-b2a6-1fc89d7ce022 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034140 Sep 10 14:21:44.164610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 468/941] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 10 14:21:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:44.176287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ea75a79e-753d-44b5-9f99-00edf3875372 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6ba87c280>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:44.205897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ea75a79e-753d-44b5-9f99-00edf3875372 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.034142 Sep 10 14:21:44.206439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 474/942] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:44 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:45.219020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a6598cba-8da5-4f85-a4e2-1c2e9e32681b tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b70b3430>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:45.249297 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a6598cba-8da5-4f85-a4e2-1c2e9e32681b tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.034589 Sep 10 14:21:45.249848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 469/943] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:45 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:45.873180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:45.873748 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:45.880363 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:45.880846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:45.881308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:45.881996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:45.882449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:45.882872 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:45.906350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2cfdc60c-0663-4b32-8c26-d6a0e49ddd11 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/ips" status: 200 len: 149 microversion: 2.1 time: 0.037568 Sep 10 14:21:45.907136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 475/944] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:21:45 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:46.262546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5e3b6977-ba37-4b18-93af-8ab48a449063 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fd4160>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:46.292813 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5e3b6977-ba37-4b18-93af-8ab48a449063 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.034592 Sep 10 14:21:46.293376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 470/945] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:46 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:47.305938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9c47a2a4-22b2-46e4-9cd6-7daa378f7ead tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b717cb80>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:47.336391 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9c47a2a4-22b2-46e4-9cd6-7daa378f7ead tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.034206 Sep 10 14:21:47.336942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 476/946] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:47 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:48.350194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1be8f6a9-f1fb-4287-95a0-6653390b5e52 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6f850d0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:48.380293 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1be8f6a9-f1fb-4287-95a0-6653390b5e52 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.034313 Sep 10 14:21:48.380846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 471/947] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:48 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:49.343948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5da4465a-32ae-4117-afd3-5bd1ee611a74"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:49.346667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:49.353238 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:49.353742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:49.354167 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:49.354861 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:49.355320 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:49.355781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:49.393071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-52f18f4d-db63-4013-8bb1-5ed79fb52364 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fbdd30>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:49.423736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-52f18f4d-db63-4013-8bb1-5ed79fb52364 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 287 microversion: 2.1 time: 0.034644 Sep 10 14:21:49.424627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 472/948] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:49 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:21:49.435589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-caae2dee-086f-4aa1-ac7a-f41dcbeae4e1 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b70b3430>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:49.494044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-caae2dee-086f-4aa1-ac7a-f41dcbeae4e1 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 202 len: 0 microversion: 2.1 time: 0.062252 Sep 10 14:21:49.494797 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 473/949] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Sep 10 14:21:49 2022] DELETE /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:49.504151 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dad26db3-4fcb-4001-9c7a-4fd1c34dbf70 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fe3ee0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:49.535350 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dad26db3-4fcb-4001-9c7a-4fd1c34dbf70 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 200 len: 286 microversion: 2.1 time: 0.036249 Sep 10 14:21:49.536013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 474/950] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:49 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:21:49.657121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:49.676996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-19525788-8212-48f3-a034-c2b6bf3dfb3d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337586 Sep 10 14:21:49.677603 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 477/951] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:21:49 2022] POST /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:21:50.549548 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d4c987d4-6295-4ff0-8bc6-adac831f8ca0 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fcf430>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:50.573766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-d4c987d4-6295-4ff0-8bc6-adac831f8ca0 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] HTTP exception thrown: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d4c987d4-6295-4ff0-8bc6-adac831f8ca0 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Request method failure captured: Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd HTTP/1.1 Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ12b4mWGp-Ta4EnHyRvjDr5NK6dz35_kI4qJ4PUP8HhzZFTMPT4xGHHlMis4yVbxgQQF5OGgEFVJE4WC07J7dUF7AmH7kGcHzKmJ1Fc4ruvse3DKy_NnFld4Ly8kmwuIesfI-nf3QEFO-GmNpGPxvKc6AyYuzZ0mritF5ohGJss2nM Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:21:50.576200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ba6e747296f47119282c836ef7ddc4e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}] Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: fd369300973c4c6d9f570c323edcd23f Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'bdad4ded-ba10-4957-83f4-f9efab2b25cd'} Sep 10 14:21:50.577727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. (HTTP 404) (Request-ID: req-078d2e45-366f-44dd-9624-6c91c2748dca) Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.578687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:21:50.580290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 10 14:21:50.581626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d4c987d4-6295-4ff0-8bc6-adac831f8ca0 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Returning 404 to user: Snapshot bdad4ded-ba10-4957-83f4-f9efab2b25cd could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:50.583068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d4c987d4-6295-4ff0-8bc6-adac831f8ca0 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd" status: 404 len: 111 microversion: 2.1 time: 0.033151 Sep 10 14:21:50.584106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 475/952] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 10 14:21:50 2022] GET /compute/v2.1/os-snapshots/bdad4ded-ba10-4957-83f4-f9efab2b25cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:21:50.587158 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-677e7d62-cf51-4e36-bbfd-15ad814b4b15 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b720f9d0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:50.648783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-677e7d62-cf51-4e36-bbfd-15ad814b4b15 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 202 len: 0 microversion: 2.1 time: 0.065742 Sep 10 14:21:50.649524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 478/953] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:21:50 2022] DELETE /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:50.658229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1794e275-6081-4465-bd75-079a95183eaa tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fd88b0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:50.711355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1794e275-6081-4465-bd75-079a95183eaa tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 200 len: 345 microversion: 2.1 time: 0.057603 Sep 10 14:21:50.712107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 476/954] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:21:50 2022] GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:51.727120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5e437367-c3b7-438e-8cb7-bf13002c798d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6ba87c550>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:51.754497 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-5e437367-c3b7-438e-8cb7-bf13002c798d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] HTTP exception thrown: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5e437367-c3b7-438e-8cb7-bf13002c798d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Request method failure captured: Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f HTTP/1.1 Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJ12b4mWGp-Ta4EnHyRvjDr5NK6dz35_kI4qJ4PUP8HhzZFTMPT4xGHHlMis4yVbxgQQF5OGgEFVJE4WC07J7dUF7AmH7kGcHzKmJ1Fc4ruvse3DKy_NnFld4Ly8kmwuIesfI-nf3QEFO-GmNpGPxvKc6AyYuzZ0mritF5ohGJss2nM Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:21:51.757170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ba6e747296f47119282c836ef7ddc4e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}] Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: fd369300973c4c6d9f570c323edcd23f Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '6bf8d12d-79f7-4a82-8ce3-6ffa515e149f'} Sep 10 14:21:51.758669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. (HTTP 404) (Request-ID: req-b6ac1150-afca-4d73-9649-bdaedff3c0d5) Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.759599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:21:51.760806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 14:21:51.761974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5e437367-c3b7-438e-8cb7-bf13002c798d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Returning 404 to user: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5e437367-c3b7-438e-8cb7-bf13002c798d tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 404 len: 109 microversion: 2.1 time: 0.035812 Sep 10 14:21:51.763080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 479/955] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:21:51 2022] GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:21:51.770200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=21 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:51.770956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:21:51.776115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac31df3d-8720-4af6-b30a-198453ea348e tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b6fbdaf0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:51.805676 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-ac31df3d-8720-4af6-b30a-198453ea348e tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] HTTP exception thrown: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac31df3d-8720-4af6-b30a-198453ea348e tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Request method failure captured: Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f HTTP/1.1 Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ12b4mWGp-Ta4EnHyRvjDr5NK6dz35_kI4qJ4PUP8HhzZFTMPT4xGHHlMis4yVbxgQQF5OGgEFVJE4WC07J7dUF7AmH7kGcHzKmJ1Fc4ruvse3DKy_NnFld4Ly8kmwuIesfI-nf3QEFO-GmNpGPxvKc6AyYuzZ0mritF5ohGJss2nM Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:21:51.807810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ba6e747296f47119282c836ef7ddc4e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}] Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: fd369300973c4c6d9f570c323edcd23f Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '6bf8d12d-79f7-4a82-8ce3-6ffa515e149f'} Sep 10 14:21:51.809392 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. (HTTP 404) (Request-ID: req-86282be4-976c-4524-8715-0bacd9181652) Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.810316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 14:21:51.812149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 14:21:51.813825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac31df3d-8720-4af6-b30a-198453ea348e tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Returning 404 to user: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ac31df3d-8720-4af6-b30a-198453ea348e tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 404 len: 109 microversion: 2.1 time: 0.040041 Sep 10 14:21:51.815280 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 477/956] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:21:51 2022] DELETE /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 14:21:51.821344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b135d6dc-8fb7-4f86-ab8c-a56f93c4c780 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Calling method '.version_select at 0x7ff6b7271ee0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-b135d6dc-8fb7-4f86-ab8c-a56f93c4c780 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] HTTP exception thrown: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b135d6dc-8fb7-4f86-ab8c-a56f93c4c780 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Request method failure captured: Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f HTTP/1.1 Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJ12b4mWGp-Ta4EnHyRvjDr5NK6dz35_kI4qJ4PUP8HhzZFTMPT4xGHHlMis4yVbxgQQF5OGgEFVJE4WC07J7dUF7AmH7kGcHzKmJ1Fc4ruvse3DKy_NnFld4Ly8kmwuIesfI-nf3QEFO-GmNpGPxvKc6AyYuzZ0mritF5ohGJss2nM Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:21:51.863012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ba6e747296f47119282c836ef7ddc4e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ba6e747296f47119282c836ef7ddc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ba6e747296f47119282c836ef7ddc4e"}]}] Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 5ba6e747296f47119282c836ef7ddc4e Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2000746118 Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: fd369300973c4c6d9f570c323edcd23f Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2000746118-project Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '6bf8d12d-79f7-4a82-8ce3-6ffa515e149f'} Sep 10 14:21:51.864588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. (HTTP 404) (Request-ID: req-a6d91ddc-ba33-4cb7-bd65-c2d79df7ee6f) Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.865364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:21:51.866540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 14:21:51.867755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b135d6dc-8fb7-4f86-ab8c-a56f93c4c780 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] Returning 404 to user: Volume 6bf8d12d-79f7-4a82-8ce3-6ffa515e149f could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b135d6dc-8fb7-4f86-ab8c-a56f93c4c780 tempest-VolumesSnapshotsTestJSON-2000746118 tempest-VolumesSnapshotsTestJSON-2000746118-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f" status: 404 len: 109 microversion: 2.1 time: 0.036214 Sep 10 14:21:51.868928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 480/957] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:21:51 2022] GET /compute/v2.1/os-volumes/6bf8d12d-79f7-4a82-8ce3-6ffa515e149f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:21:57.244911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5da4465a-32ae-4117-afd3-5bd1ee611a74"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:21:57.248565 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:57.255896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:57.256378 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:57.256811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:57.257496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:57.257941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:57.258359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:57.338052 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Invalid volume: volume 5da4465a-32ae-4117-afd3-5bd1ee611a74 is already attached to instances: 028facf8-adb9-4054-9c61-5420c17ce80f Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: POST /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments HTTP/1.1 Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 74 Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:21:57.339804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {"volumeAttachment": {"volumeId": "5da4465a-32ae-4117-afd3-5bd1ee611a74"}} Sep 10 14:21:57.342090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Invalid volume: volume 5da4465a-32ae-4117-afd3-5bd1ee611a74 is already attached to instances: 028facf8-adb9-4054-9c61-5420c17ce80f Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'server_id': '028facf8-adb9-4054-9c61-5420c17ce80f', 'body': {'volumeAttachment': {'volumeId': '5da4465a-32ae-4117-afd3-5bd1ee611a74'}}} Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5da4465a-32ae-4117-afd3-5bd1ee611a74 is already attached to instances: 028facf8-adb9-4054-9c61-5420c17ce80f Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:57.342927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5da4465a-32ae-4117-afd3-5bd1ee611a74 is already attached to instances: 028facf8-adb9-4054-9c61-5420c17ce80f Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:21:57.344810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5da4465a-32ae-4117-afd3-5bd1ee611a74 is already attached to instances: 028facf8-adb9-4054-9c61-5420c17ce80f Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 400 to user: Invalid volume: volume 5da4465a-32ae-4117-afd3-5bd1ee611a74 is already attached to instances: 028facf8-adb9-4054-9c61-5420c17ce80f {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9101458c-7721-4a80-b8ff-7e1133c50fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101146 Sep 10 14:21:57.346807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 478/958] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:21:57 2022] POST /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:21:57.411526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:57.412151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:57.418283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:57.418763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:57.419195 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:57.419912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:57.420371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:57.420791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:57.501071 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lazy-loading 'services' on Instance uuid 028facf8-adb9-4054-9c61-5420c17ce80f {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:21:57.575654 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9c92c21e-8b4b-48f4-806d-03c6f55c890b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments/5da4465a-32ae-4117-afd3-5bd1ee611a74" status: 202 len: 0 microversion: 2.1 time: 0.168971 Sep 10 14:21:57.576240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 481/959] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:21:57 2022] DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments/5da4465a-32ae-4117-afd3-5bd1ee611a74 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:21:57.586275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:57.588535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:57.595718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:57.596366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:57.597009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:57.597712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:57.598167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:57.598595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:57.631208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7c092ef2-6040-431c-9010-f22c0203dd7d tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050272 Sep 10 14:21:57.631700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 479/960] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:21:57 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:21:58.645682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:58.648123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:58.654293 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:58.654774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:58.655207 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:58.655930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:58.656424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:58.656881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:58.685566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-58306625-2caa-4719-b07f-8cc649336e64 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045465 Sep 10 14:21:58.686123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 482/961] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:21:58 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:21:58.754267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:58.755637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:58.762052 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:58.762474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:58.762911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:58.763629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:58.764139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:58.764551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:58.793325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:21:58.872507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-af26f7df-f070-48ec-8d14-d09337218072 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 204 len: 0 microversion: 2.1 time: 0.122273 Sep 10 14:21:58.873150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 480/962] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:21:58 2022] DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 14:21:58.883240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:21:58.884260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:21:58.890808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:58.891550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:58.892171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:58.892866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:21:58.893515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:21:58.894176 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:21:59.034165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:21:59.042113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-22d47e9c-dc1a-41b8-a132-a186b94793e1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1682 microversion: 2.1 time: 0.162984 Sep 10 14:21:59.042800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 483/963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:21:58 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:22:00.066421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:00.067126 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:00.073459 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:00.073896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:00.074321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:00.075023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:00.075508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:00.075927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:00.216260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:00.224572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-014c058a-0446-4779-9881-807a127f8cd7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1682 microversion: 2.1 time: 0.162479 Sep 10 14:22:00.225128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 481/964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:00 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:01.248315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:01.248950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:01.256309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:01.256795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:01.257236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:01.257941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:01.258429 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:01.258953 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:01.564374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:01.575120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-babd6ff6-6e6d-4b81-862e-ffb53857887c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1682 microversion: 2.1 time: 0.330738 Sep 10 14:22:01.590583 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 484/965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:01 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:02.037979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-88dcd15c-0899-4834-974e-a8b7f1aa8f1a req-44eb088c-f3ee-4c0e-ae67-99b5a3443208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028facf8-adb9-4054-9c61-5420c17ce80f", "name": "network-vif-deleted", "tag": "8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:02.051822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-88dcd15c-0899-4834-974e-a8b7f1aa8f1a req-44eb088c-f3ee-4c0e-ae67-99b5a3443208 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:02.052572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-88dcd15c-0899-4834-974e-a8b7f1aa8f1a req-44eb088c-f3ee-4c0e-ae67-99b5a3443208 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:02.053155 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-88dcd15c-0899-4834-974e-a8b7f1aa8f1a req-44eb088c-f3ee-4c0e-ae67-99b5a3443208 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:02.068152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-88dcd15c-0899-4834-974e-a8b7f1aa8f1a req-44eb088c-f3ee-4c0e-ae67-99b5a3443208 service nova] Creating event network-vif-deleted:8fcd64b5-0df4-46a3-a8dd-d56e0ee7fa04 for instance 028facf8-adb9-4054-9c61-5420c17ce80f on hv-cinder-85690 Sep 10 14:22:02.075238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-88dcd15c-0899-4834-974e-a8b7f1aa8f1a req-44eb088c-f3ee-4c0e-ae67-99b5a3443208 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040745 Sep 10 14:22:02.082327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 482/966] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:02.598474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:02.599778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:02.602298 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:02.607990 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:02.608483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:02.608925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:02.609741 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:02.610110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:02.610531 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:02.646341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:02.646844 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:02.647246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:02.647781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lazy-loading 'fault' on Instance uuid 028facf8-adb9-4054-9c61-5420c17ce80f {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:22:02.693104 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:02.702579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a50d3798-82ea-4254-8860-8d9387f15b79 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 200 len: 1332 microversion: 2.1 time: 0.108372 Sep 10 14:22:02.703253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 485/967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:02 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:03.728005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:03.728720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:03.736169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:03.736663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:03.737104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:03.737808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:03.738517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:03.738944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:03.752944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f HTTP/1.1 Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:22:03.754988 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:22:03.756610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '028facf8-adb9-4054-9c61-5420c17ce80f'} Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:22:03.757428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:22:03.758647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:03.759790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:22:03.759790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ac44ad88-e2ac-48cd-9a50-8e60ae19072c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 404 len: 111 microversion: 2.1 time: 0.032718 Sep 10 14:22:03.759790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 483/968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:03 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:22:03.765522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fd9799bc-7b72-4ea7-9bd8-0ba7a185f78a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '.version_select at 0x7ff6b7206e50>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:03.786117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fd9799bc-7b72-4ea7-9bd8-0ba7a185f78a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008121697" status: 202 len: 0 microversion: 2.1 time: 0.024380 Sep 10 14:22:03.786793 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 486/969] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 10 14:22:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008121697 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:22:04.458050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b61370f6-34d1-47ff-a09e-c392d892a5d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: .version_select at 0x7ff6b6f854c0>, body: {"keypair": {"name": "tempest-keypair-915489864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHG95EsKd22rYbmiOAimHsrSNeN+laeySoCq39mFxPt0lY5hSg7pNO6r8cSaPXltOoyMg+LP7fsgasKYEPwTO+ij89+e/X+S741p23UcTNR287vo/MCEf6F7iGveT9HXrQ=="}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:04.474604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-b61370f6-34d1-47ff-a09e-c392d892a5d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:22:04.480030 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-b61370f6-34d1-47ff-a09e-c392d892a5d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'key_pairs'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:22:04.505602 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b61370f6-34d1-47ff-a09e-c392d892a5d1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052714 Sep 10 14:22:04.506568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 484/970] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:22:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:05.939107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-991658663", "imageRef": "2b13df91-b9d3-48f2-88db-8694041b80e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6130204-567f-432e-9831-4386656cd324"}], "security_groups": [{"name": "tempest-securitygroup--1529483730"}], "key_name": "tempest-keypair-915489864", "user_data": "}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:06.048623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] validate_networks() for [('c6130204-567f-432e-9831-4386656cd324', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:22:06.456145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:22:06.456572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:22:06.457049 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:22:06.457457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:22:06.457937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:22:06.467636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:06.468182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:06.468883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:06.469851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:06.470305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:06.470938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:06.491047 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:22:06.505400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Getting quotas for user db2f1171c5394a1c8879cd09c1e685b1 and project 68f11e95e757488fa7c4c156194d24ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:22:06.517107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:22:06.519419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b13df91-b9d3-48f2-88db-8694041b80e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:22:06.567918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e5fd3295-cd1f-43a5-83d0-48297325da6e tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.634189 Sep 10 14:22:06.568597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 487/971] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:22:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:22:06.580531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8c2a7cd4-8da3-47a4-a63d-6b373810516c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:06.581140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8c2a7cd4-8da3-47a4-a63d-6b373810516c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:06.640861 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8c2a7cd4-8da3-47a4-a63d-6b373810516c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:06.648893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8c2a7cd4-8da3-47a4-a63d-6b373810516c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1240 microversion: 2.1 time: 0.072982 Sep 10 14:22:06.649653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 485/972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:06 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:22:07.672110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:07.672965 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:07.679111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:07.679655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:07.680093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:07.680787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:07.681247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:07.681669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:07.753046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:07.762123 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f083d830-d836-43b3-8cc8-4c40d61224cf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1292 microversion: 2.1 time: 0.094492 Sep 10 14:22:07.762775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 488/973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:07 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:08.786039 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:08.786649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:08.793314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:08.793799 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:08.794230 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:08.794914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:08.795367 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:08.795827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:08.931335 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:08.939272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3512ba9e-c943-4325-8525-367d586f51a4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.157009 Sep 10 14:22:08.939867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 486/974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:08 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:09.962043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:09.962643 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:09.970016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:09.970484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:09.971027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:09.971741 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:09.972192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:09.972608 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:10.350087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:10.357696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d116e001-80cc-4523-839e-88a9282c88d8 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.399482 Sep 10 14:22:10.358252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 489/975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:09 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:11.380747 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:11.381355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:11.387739 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:11.388217 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:11.388650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:11.389325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:11.389772 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:11.390190 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:11.523436 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:11.534208 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d8bdf47e-1da3-44a9-aa77-fdf3ee1e951c tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.157174 Sep 10 14:22:11.534996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 487/976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:11 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:22:12.093836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-96d8b555-05a0-4f4e-a8e8-155559c1fc21 req-8a5415c0-2ed2-482a-864a-314923f74d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be25ecec-8682-4136-9f67-f906075122b4", "tag": "579fa464-e6ee-492c-bff1-065ee60ed4c5"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:12.104780 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-96d8b555-05a0-4f4e-a8e8-155559c1fc21 req-8a5415c0-2ed2-482a-864a-314923f74d5d service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:12.105266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-96d8b555-05a0-4f4e-a8e8-155559c1fc21 req-8a5415c0-2ed2-482a-864a-314923f74d5d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:12.105750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-96d8b555-05a0-4f4e-a8e8-155559c1fc21 req-8a5415c0-2ed2-482a-864a-314923f74d5d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:12.118004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-96d8b555-05a0-4f4e-a8e8-155559c1fc21 req-8a5415c0-2ed2-482a-864a-314923f74d5d service nova] Creating event network-changed:579fa464-e6ee-492c-bff1-065ee60ed4c5 for instance be25ecec-8682-4136-9f67-f906075122b4 on hv-cinder-85690 Sep 10 14:22:12.122941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-96d8b555-05a0-4f4e-a8e8-155559c1fc21 req-8a5415c0-2ed2-482a-864a-314923f74d5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033137 Sep 10 14:22:12.123579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 490/977] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:12.558356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:12.558976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:12.564906 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:12.565391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:12.565822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:12.566510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:12.566962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:12.567384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:12.696605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:12.704588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a1ec5571-6f99-4b2c-89c5-fa38c7f87593 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.150246 Sep 10 14:22:12.705182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 488/978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:12 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:13.729161 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:13.729786 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:13.736074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:13.736559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:13.737000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:13.737694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:13.738413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:13.738852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:13.868258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:13.876611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4ac678d4-8a89-44a0-beef-902ad69ffd13 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.152223 Sep 10 14:22:13.877188 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 491/979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:13 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:14.899252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:14.899848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:14.907851 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:14.908322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:14.908756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:14.909438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:14.909911 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:14.910332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:15.042451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:15.050024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2e600b99-4185-4bce-a3d2-a93b75ec78ba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.154647 Sep 10 14:22:15.050586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 489/980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:14 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:16.072334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:16.072942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:16.080235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:16.080716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:16.081146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:16.081828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:16.082276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:16.082694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:16.218687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:16.226370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a82928d5-2a1a-4eb9-b2de-dc71801ef6d9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.157934 Sep 10 14:22:16.226924 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 492/981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:16 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:17.249563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:17.250963 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:17.253371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:17.258730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:17.259223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:17.259691 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:17.260386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:17.260844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:17.261272 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:17.391784 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:17.399220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a5159c92-6342-467b-80fd-d9770673b073 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.153486 Sep 10 14:22:17.399810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 490/982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:17 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:18.422251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:18.425011 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:18.427829 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:18.428612 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:18.431125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:18.431640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:18.432078 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:18.432771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:18.433228 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:18.433650 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:18.562822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:18.570470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d9925e51-ea4b-4900-ae30-3ca5e622cdba tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.152258 Sep 10 14:22:18.571027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 493/983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:18 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:18.610941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:18.611522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:18.618068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:18.618544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:18.618973 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:18.619701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:18.620158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:18.620575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:18.645033 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e4b4d3f5-a9d1-4e85-bd0b-17738b0dbaf4 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/ips" status: 200 len: 153 microversion: 2.20 time: 0.038942 Sep 10 14:22:18.645595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 491/984] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Sep 10 14:22:18 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:22:19.595165 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:19.596066 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:19.602477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:19.603220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:19.603692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:19.604697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:19.605246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:19.605659 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:19.842537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:19.845694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:19.852657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2b06a0e6-c0ec-416e-893e-e4c5754c9a5f tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.262290 Sep 10 14:22:19.853227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 494/985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:19 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:20.766342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:20.767090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:20.774682 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:20.775169 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:20.775677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:20.776374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:20.776820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:20.777480 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:20.801138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lazy-loading 'flavor' on Instance uuid e8f518a0-dce2-48aa-ac83-7fe61cd4118e {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:22:20.877062 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:20.877677 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:20.884836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:20.885321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:20.885757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:20.886445 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:20.886899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:20.887323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:20.992034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-20704383-8c55-4c67-a544-e5e7749eb8d2 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/action" status: 202 len: 0 microversion: 2.20 time: 0.230165 Sep 10 14:22:20.992625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 492/986] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 10 14:22:20 2022] POST /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:22:21.001633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:21.002652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:21.009892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:21.010585 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:21.011301 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:21.012210 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:21.012740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:21.013348 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:21.036898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:21.045196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b002e71a-69cf-4420-bca6-b715c8fc6908 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.172877 Sep 10 14:22:21.045775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 495/987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:20 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:22:21.298800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:21.306780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:21.308266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:21.309430 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-742ff763-8e84-4726-a163-e6ed52338e12 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.312335 Sep 10 14:22:21.309981 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 493/988] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:20 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:22:21.681283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-ec9cfd79-1b01-4bdc-96fc-b9da816b9ea8 req-42b1c2a6-2e23-4ebd-8abf-b52488a86f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be25ecec-8682-4136-9f67-f906075122b4", "name": "network-vif-plugged", "status": "completed", "tag": "579fa464-e6ee-492c-bff1-065ee60ed4c5"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:21.693730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ec9cfd79-1b01-4bdc-96fc-b9da816b9ea8 req-42b1c2a6-2e23-4ebd-8abf-b52488a86f99 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:21.694424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ec9cfd79-1b01-4bdc-96fc-b9da816b9ea8 req-42b1c2a6-2e23-4ebd-8abf-b52488a86f99 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:21.695048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ec9cfd79-1b01-4bdc-96fc-b9da816b9ea8 req-42b1c2a6-2e23-4ebd-8abf-b52488a86f99 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:21.709109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-ec9cfd79-1b01-4bdc-96fc-b9da816b9ea8 req-42b1c2a6-2e23-4ebd-8abf-b52488a86f99 service nova] Creating event network-vif-plugged:579fa464-e6ee-492c-bff1-065ee60ed4c5 for instance be25ecec-8682-4136-9f67-f906075122b4 on hv-cinder-85690 Sep 10 14:22:21.714758 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-ec9cfd79-1b01-4bdc-96fc-b9da816b9ea8 req-42b1c2a6-2e23-4ebd-8abf-b52488a86f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036942 Sep 10 14:22:21.715727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 496/989] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:22.069311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:22.069823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:22.072275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:22.077672 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:22.078856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:22.079555 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:22.080255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:22.080707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:22.081159 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:22.086044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:22.212575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:22.220384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5625ecfa-3dd6-4066-9e89-bbea75c80fd0 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.155029 Sep 10 14:22:22.220935 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 494/990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:22 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:22.336020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:22.336669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:22.343466 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:22.344862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:22.345362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:22.346050 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:22.346502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:22.346921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:22.479712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:22.487812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:22.489540 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:22.490716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-32795102-8fc7-4a87-a456-29ea52ce182d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.159099 Sep 10 14:22:22.491278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 497/991] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:22 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:23.243897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:23.244465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:23.251579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:23.252063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:23.252498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:23.253183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:23.253637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:23.254060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:23.384521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:23.392987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9bc7d977-0893-487b-80aa-102ed647f131 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.153068 Sep 10 14:22:23.393550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 495/992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:23 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:23.517111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:23.517641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:23.524014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:23.524493 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:23.524923 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:23.525600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:23.526051 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:23.526468 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:23.655555 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:23.663686 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:23.665135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:23.666289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-73cb4cb0-6fc3-4232-abd0-94aa309910bd tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.153854 Sep 10 14:22:23.666842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 498/993] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:23 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:24.415593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:24.416221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:24.423158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:24.423675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:24.424114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:24.424869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:24.425322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:24.425751 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:24.559653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:24.567945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-61c04072-bdd6-4757-9d6b-114ed4dbcd31 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.156377 Sep 10 14:22:24.568501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 496/994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:24 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:24.691449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:24.692085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:24.698518 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:24.699001 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:24.699434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:24.700143 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:24.700611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:24.701038 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:24.833988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:24.842083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:24.844225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:24.845462 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c71baf21-b413-4b58-8f84-9b140e104960 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.157997 Sep 10 14:22:24.846019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 499/995] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:24 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:25.590579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:25.591193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:25.599211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:25.599718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:25.600150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:25.600832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:25.601281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:25.601701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:25.729863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:25.738680 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f0528362-f1da-4338-b6ff-df5777ffb2b5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.151683 Sep 10 14:22:25.739225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 497/996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:25 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:25.871115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:25.871746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:25.878334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:25.878809 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:25.879238 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:25.879943 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:25.880392 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:25.880808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:26.013032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:26.022306 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:26.024115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:26.025341 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ed0fede8-8c1d-40c5-a720-7f2db4450594 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.158072 Sep 10 14:22:26.025933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 500/997] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:25 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:26.761634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:26.762182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:26.769203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:26.769693 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:26.770127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:26.770848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:26.771302 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:26.771757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:26.903782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:26.913104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-45e66dda-b11f-443b-8db1-ff95a44591ee tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1366 microversion: 2.1 time: 0.155382 Sep 10 14:22:26.913666 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 498/998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:26 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:27.052713 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:27.053243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:27.059681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:27.060171 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:27.060609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:27.061297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:27.061753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:27.062177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:27.193545 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:27.201610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:27.203190 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:27.204485 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b3f7b6bc-2bc4-4360-9160-3c1cba723656 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.155766 Sep 10 14:22:27.205259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 501/999] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:27 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:27.936488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:27.937100 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:27.943978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:27.944457 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:27.944887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:27.945570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:27.946014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:27.946430 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:28.080391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:28.088063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-38dece4e-e9c6-4d09-900d-14f6fdad30e9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1555 microversion: 2.1 time: 0.155425 Sep 10 14:22:28.088619 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 499/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:27 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:28.112406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:28.112986 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:28.120268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:28.120762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:28.121208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:28.121914 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:28.122372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:28.122794 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:28.205223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-90849df6-47a2-42fd-9f64-aedd042325f6 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097576 Sep 10 14:22:28.205853 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 502/1001] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 10 14:22:28 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:28.230251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:28.230877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:28.237117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:28.237591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:28.238025 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:28.238983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:28.239435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:28.239881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:28.373796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:28.382429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:28.383906 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:28.385100 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e96a0f21-9442-4957-8017-342a1b4f3b33 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.158970 Sep 10 14:22:28.385655 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 500/1002] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:28 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:29.142384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-76a9a3e8-10d3-4d23-8046-621e3ea7c161 req-599a62aa-ecc8-477c-9b5b-b5bebb36ae17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be25ecec-8682-4136-9f67-f906075122b4", "tag": "579fa464-e6ee-492c-bff1-065ee60ed4c5"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:29.152089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-76a9a3e8-10d3-4d23-8046-621e3ea7c161 req-599a62aa-ecc8-477c-9b5b-b5bebb36ae17 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:29.152650 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-76a9a3e8-10d3-4d23-8046-621e3ea7c161 req-599a62aa-ecc8-477c-9b5b-b5bebb36ae17 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:29.153153 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-76a9a3e8-10d3-4d23-8046-621e3ea7c161 req-599a62aa-ecc8-477c-9b5b-b5bebb36ae17 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:29.167628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-76a9a3e8-10d3-4d23-8046-621e3ea7c161 req-599a62aa-ecc8-477c-9b5b-b5bebb36ae17 service nova] Creating event network-changed:579fa464-e6ee-492c-bff1-065ee60ed4c5 for instance be25ecec-8682-4136-9f67-f906075122b4 on hv-cinder-85690 Sep 10 14:22:29.174088 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-76a9a3e8-10d3-4d23-8046-621e3ea7c161 req-599a62aa-ecc8-477c-9b5b-b5bebb36ae17 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035823 Sep 10 14:22:29.174781 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 503/1003] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:29.411158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:29.411908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:29.420539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:29.421087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:29.421522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:29.422229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:29.423542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:29.423964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:29.569679 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:29.578278 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:29.580326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:29.581502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-484998e9-3cc0-4da6-8eb9-64f2c6db8f06 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.175102 Sep 10 14:22:29.582055 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 501/1004] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:29 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:22:30.608329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:30.609019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:30.615724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:30.616202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:30.616634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:30.617310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:30.617760 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:30.618177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:30.749517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:30.757876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:30.759311 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:30.760485 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9f1f4fe1-1df5-44ea-b1a4-1e75d8240d94 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.156530 Sep 10 14:22:30.761041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 504/1005] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:30 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:31.787253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:31.787914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:31.794343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:31.794832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:31.795267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:31.796002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:31.796508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:31.796919 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:31.936114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:31.944339 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:31.945818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:31.946985 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-05a0deee-74b7-4cdf-99ec-60dbeb8c2c1f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.163653 Sep 10 14:22:31.947622 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 502/1006] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:31 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:22:32.974867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:32.975510 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:32.978085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:32.989016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:32.989511 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:32.989956 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:32.990787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:32.991212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:32.991634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:33.132795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:33.141933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:33.143390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:33.144834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-06f51ced-173f-4f38-9209-7e030988b4de tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.173964 Sep 10 14:22:33.147828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 505/1007] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:32 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:34.170294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:34.171081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:34.180702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:34.181565 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:34.182023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:34.182725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:34.183193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:34.183835 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:34.404931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:34.414539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:34.416265 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:34.418035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-30e9f941-16c8-48ad-8540-a8ad49b15b35 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.251504 Sep 10 14:22:34.419250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 503/1008] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:34 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:35.444977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:35.445622 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:35.452028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:35.452682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:35.453267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:35.454808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:35.455415 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:35.456056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:35.664757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:35.676243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:35.677789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:35.678888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e0080850-4f5e-4d90-93e8-7a937da2b970 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.237930 Sep 10 14:22:35.679460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 506/1009] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:35 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:36.707225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:36.707225 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:36.714875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:36.715359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:36.718109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:36.718970 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:36.719681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:36.720262 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:36.888609 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:36.899066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:36.901019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:36.902290 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1d8b47ae-b1f4-46da-9f65-0a7bace5acf5 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.200922 Sep 10 14:22:36.903408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 504/1010] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:36 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:37.930297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:37.931272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:37.939113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:37.939633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:37.940076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:37.940975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:37.941432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:37.941858 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:38.198065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:38.207377 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:38.208863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:38.210073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d8a34f10-cd23-4290-a62e-e63e90244a05 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1746 microversion: 2.20 time: 0.283875 Sep 10 14:22:38.210647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 507/1011] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:37 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1746 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:39.237728 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:39.239199 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:39.245788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:39.247048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:39.247530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:39.248399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:39.249366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:39.249967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:39.396611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:39.407418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:39.409173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:39.410874 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b4432d72-83ae-4e5e-a69e-a6fa3ad1f042 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1746 microversion: 2.20 time: 0.178220 Sep 10 14:22:39.411469 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 505/1012] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:39 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:40.443738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:40.444352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:40.451368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:40.458831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:40.459491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:40.460587 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:40.461206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:40.461959 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:40.700268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:40.709995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:40.711706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:40.716075 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-36a0d576-7af7-4d1a-9e33-e6ef52633959 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1746 microversion: 2.20 time: 0.276748 Sep 10 14:22:40.716828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 508/1013] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:40 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1746 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:41.748051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:41.748657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:41.759356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:41.760515 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:41.761327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:41.762251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:41.762718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:41.763150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:41.960509 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:41.972001 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:41.981477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:41.982893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-77bc75da-7767-4a26-85f1-738f608db178 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1746 microversion: 2.20 time: 0.239239 Sep 10 14:22:41.983490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 506/1014] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:41 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1746 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:42.209529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-f356f17b-0fd4-41f3-a805-18ff315ae5d7 req-1e1579ec-4cae-425a-9829-1e57a2150d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "name": "network-vif-plugged", "status": "completed", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:42.221102 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-f356f17b-0fd4-41f3-a805-18ff315ae5d7 req-1e1579ec-4cae-425a-9829-1e57a2150d5d service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:42.222123 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-f356f17b-0fd4-41f3-a805-18ff315ae5d7 req-1e1579ec-4cae-425a-9829-1e57a2150d5d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:42.222559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-f356f17b-0fd4-41f3-a805-18ff315ae5d7 req-1e1579ec-4cae-425a-9829-1e57a2150d5d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:42.237889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-f356f17b-0fd4-41f3-a805-18ff315ae5d7 req-1e1579ec-4cae-425a-9829-1e57a2150d5d service nova] Creating event network-vif-plugged:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:22:42.245434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-f356f17b-0fd4-41f3-a805-18ff315ae5d7 req-1e1579ec-4cae-425a-9829-1e57a2150d5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039982 Sep 10 14:22:42.246146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f112c995-d75c-43ea-a422-c62068a6c178 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Action: 'create', calling method: .version_select at 0x7ff6b720f550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1666901075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1qNtEQoJLx+rMSeYMfT9O1NHPxSMXfVuihybpq0xV5CakzQHwuZOyl7pCiQTFs5GYk6icy5ohliSITYFIMcxE0vNRFL5nnIJl9JOSBPpPjJOcPxzYyManpzvA0thH7zw=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:42.246632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 507/1015] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:22:42.263528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-f112c995-d75c-43ea-a422-c62068a6c178 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:22:42.268450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-f112c995-d75c-43ea-a422-c62068a6c178 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for user f4638a1936f5467db502bda82320b113 and project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:22:42.291050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1669239051"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:42.291881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:42.293778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f112c995-d75c-43ea-a422-c62068a6c178 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.225996 Sep 10 14:22:42.294549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 509/1016] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:22:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:42.299187 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:42.299718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:42.300153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:42.301086 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:42.301447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:42.301875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:42.507721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.network.security_group_api [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Removing security group 50014e9a-251e-4d2c-86fd-b4e3ac3efff5 from port 810f325f-bbb0-4176-bccf-7cadda251d29 Sep 10 14:22:42.983683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-eae823bd-2471-4156-9bf8-0c3169f6a505 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/action" status: 202 len: 0 microversion: 2.1 time: 0.697629 Sep 10 14:22:42.984658 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 508/1017] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:22:42 2022] POST /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 14:22:42.998016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-bec23b34-3be5-4b34-8245-af1d4ea71a0a req-f7ab4ead-aab0-4082-a060-0762f3f95cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:43.009774 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:43.010473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:43.021853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:43.022349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:43.022802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:43.023539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:43.027862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:43.030864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:43.040503 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-bec23b34-3be5-4b34-8245-af1d4ea71a0a req-f7ab4ead-aab0-4082-a060-0762f3f95cd7 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:43.046262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-bec23b34-3be5-4b34-8245-af1d4ea71a0a req-f7ab4ead-aab0-4082-a060-0762f3f95cd7 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:43.049292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-bec23b34-3be5-4b34-8245-af1d4ea71a0a req-f7ab4ead-aab0-4082-a060-0762f3f95cd7 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:43.074587 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-bec23b34-3be5-4b34-8245-af1d4ea71a0a req-f7ab4ead-aab0-4082-a060-0762f3f95cd7 service nova] Creating event network-changed:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:22:43.080526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-bec23b34-3be5-4b34-8245-af1d4ea71a0a req-f7ab4ead-aab0-4082-a060-0762f3f95cd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086257 Sep 10 14:22:43.086136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 510/1018] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:43.279429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:43.289994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:43.302709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:43.304393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-58a13ad4-ada4-4c85-88db-a1493a3cfb1a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1746 microversion: 2.20 time: 0.298378 Sep 10 14:22:43.311388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 509/1019] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:43 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1746 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:44.345184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:44.346981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:44.356767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:44.358329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:44.360609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:44.361740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:44.364117 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:44.366524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:44.695144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:44.712400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:44.720620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:44.721939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-52f44668-bc81-4acf-8f06-25bd84538b6b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.382385 Sep 10 14:22:44.726498 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 511/1020] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:44 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:45.114490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:45.114976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:45.128427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-739f9859-3237-4adf-b1eb-11278e4a17cf req-884858e8-e5a4-4700-bba4-03b0536a7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:45.143371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.147780 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-739f9859-3237-4adf-b1eb-11278e4a17cf req-884858e8-e5a4-4700-bba4-03b0536a7fc2 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.148290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-739f9859-3237-4adf-b1eb-11278e4a17cf req-884858e8-e5a4-4700-bba4-03b0536a7fc2 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.148733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-739f9859-3237-4adf-b1eb-11278e4a17cf req-884858e8-e5a4-4700-bba4-03b0536a7fc2 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.153384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.154846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.154846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.155197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.155530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.195202 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-739f9859-3237-4adf-b1eb-11278e4a17cf req-884858e8-e5a4-4700-bba4-03b0536a7fc2 service nova] Creating event network-changed:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:22:45.207584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-739f9859-3237-4adf-b1eb-11278e4a17cf req-884858e8-e5a4-4700-bba4-03b0536a7fc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083425 Sep 10 14:22:45.210372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 512/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:22:45.399136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lazy-loading 'services' on Instance uuid 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:22:45.584043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0b27e020-420c-4875-933d-591299670c08 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments/e0e33e89-24bd-4a25-806e-45149ad1c16f" status: 202 len: 0 microversion: 2.1 time: 0.468733 Sep 10 14:22:45.589928 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 510/1022] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:22:45 2022] DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments/e0e33e89-24bd-4a25-806e-45149ad1c16f => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:22:45.603571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:45.611033 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:45.630471 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.631361 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.632101 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.633164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.633910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.634644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.696094 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a84f5b9f-c5c3-4686-9cbe-36b6374534a7 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100328 Sep 10 14:22:45.697137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 513/1023] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:22:45 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:45.758715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:45.759431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:45.786974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.787662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.788407 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.789295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:45.789953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:45.790573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:45.794403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:46.025455 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:46.038639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:46.040596 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:46.042321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f64f8639-d8e3-4ebc-a792-e7b148447b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.288444 Sep 10 14:22:46.044149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 511/1024] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:45 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:46.719875 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:46.722904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:46.729601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:46.730276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:46.730721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:46.731431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:46.731909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:46.732599 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:46.768897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3103820d-4cb7-4953-8a0b-1ced1c334d76 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063348 Sep 10 14:22:46.770112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 514/1025] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:22:46 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:47.077331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:47.080093 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:47.097573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:47.098088 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:47.098529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:47.099240 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:47.099906 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:47.100525 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:47.339696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:47.362188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:47.368961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:47.371817 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-08d5a40c-7a4d-4e08-9ff4-7b7dbfb219c3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.302362 Sep 10 14:22:47.393804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 512/1026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:47 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:47.783425 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:47.785965 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:47.794674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:47.795419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:47.796234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:47.797127 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:47.797776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:47.798254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:47.831727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:47.850456 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-84f5e7ce-2b8d-42ec-b720-4cf6af5c3ab5 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072202 Sep 10 14:22:47.851723 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 515/1027] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:22:47 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:22:47.862605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:47.867013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:47.873783 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:47.874428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:47.874990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:47.875964 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:47.876440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:47.876871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:47.977185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] HTTP exception thrown: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 is not attached to volume e0e33e89-24bd-4a25-806e-45149ad1c16f Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Request method failure captured: Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments/e0e33e89-24bd-4a25-806e-45149ad1c16f HTTP/1.1 Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJzFI-Q729-Hh1C1TkiMz6lgwGvekgXv0eLmRrPyvfO_E9Gx8owLuUX-MSaAT21gKr3DnvtjLbYxtbcKjRIk-3U8ct6D2gH-0oZ_8_wRhGQtcPd5lOSxY4W5LmsKYFxHwLOGCouRe6ihywJEExb8XGo4vNuPQki755k9dt1uuCgHGOY Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 6109b45e7ff14addb54c4bff4fb43df6 Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestMinimumBasicScenario-1248620484 Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:22:47.980951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6109b45e7ff14addb54c4bff4fb43df6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6109b45e7ff14addb54c4bff4fb43df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6109b45e7ff14addb54c4bff4fb43df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6109b45e7ff14addb54c4bff4fb43df6"}]}] Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestMinimumBasicScenario-1248620484 Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 6109b45e7ff14addb54c4bff4fb43df6 Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1248620484 Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestMinimumBasicScenario-1248620484-project Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 993bf8937c8349e7887b3825a7034367 Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestMinimumBasicScenario-1248620484-project Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:22:47.982669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 is not attached to volume e0e33e89-24bd-4a25-806e-45149ad1c16f Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'server_id': '437bb55d-e31b-46f6-9dd1-d1aedf7cd370', 'id': 'e0e33e89-24bd-4a25-806e-45149ad1c16f'} Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e0e33e89-24bd-4a25-806e-45149ad1c16f. Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:22:47.983603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 is not attached to volume e0e33e89-24bd-4a25-806e-45149ad1c16f Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 is not attached to volume e0e33e89-24bd-4a25-806e-45149ad1c16f Sep 10 14:22:47.986419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:47.989502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Returning 404 to user: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 is not attached to volume e0e33e89-24bd-4a25-806e-45149ad1c16f {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:22:47.990438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-398aec3d-6fbb-4886-b0c3-90d97a253f2d tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments/e0e33e89-24bd-4a25-806e-45149ad1c16f" status: 404 len: 154 microversion: 2.1 time: 0.132171 Sep 10 14:22:47.992608 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 513/1028] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:22:47 2022] DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370/os-volume_attachments/e0e33e89-24bd-4a25-806e-45149ad1c16f => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:22:48.405838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:48.408441 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:48.419305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:48.419954 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:48.420492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:48.421337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:48.422016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:48.422501 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:48.642440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:48.652653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:48.655435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:48.656845 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-df8f202e-0d6e-45b9-a848-3b670ff0c363 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.256037 Sep 10 14:22:48.657742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 516/1029] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:48 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:22:49.188597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:49.189427 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:49.199407 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:49.199953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:49.200383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:49.201101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:49.201568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:49.202016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:49.240725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:22:49.360339 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bb2618ba-f940-4f9d-9152-8c444fdd3111 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 204 len: 0 microversion: 2.1 time: 0.176960 Sep 10 14:22:49.361415 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 514/1030] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:22:49 2022] DELETE /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:22:49.369847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:49.370463 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:49.379645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:49.380133 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:49.380575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:49.381277 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:49.381915 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:49.382535 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:49.565247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:49.573969 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f5ce9641-b645-4102-bb76-3ab383fb216f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1555 microversion: 2.1 time: 0.207773 Sep 10 14:22:49.575271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 517/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:49 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:49.686511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:49.687715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:49.696844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:49.697563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:49.698285 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:49.699134 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:49.699632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:49.700066 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:49.916899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:49.925836 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:49.927271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:49.928678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f55c83e7-97c0-4cac-928c-c6c4e3eaf5fe tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.247116 Sep 10 14:22:49.929399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 515/1032] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:49 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:50.599953 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:50.601679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:50.610262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:50.611210 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:50.611918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:50.612822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:50.613458 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:50.614312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:50.798236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:50.812268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8575d973-b9d3-425b-b018-c85724e4fb93 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1555 microversion: 2.1 time: 0.217351 Sep 10 14:22:50.819975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 518/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:50 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:50.955793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:50.957262 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:50.965650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:50.967363 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:50.968140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:50.969453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:50.969922 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:50.975233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:51.155393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:51.167110 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:51.169554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:51.170908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-dfdd33bc-eae2-43f8-956f-804243db18a6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.219860 Sep 10 14:22:51.183904 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 516/1034] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:50 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:51.843276 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:51.844381 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:51.850734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:51.851220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:51.851705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:51.852497 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:51.852958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:51.853386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:52.014452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:52.023934 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-44956f6b-a6a7-46ab-9344-9860d6a279ee tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1555 microversion: 2.1 time: 0.184564 Sep 10 14:22:52.024605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 519/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:51 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:52.216222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:52.217621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:52.221336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:52.226009 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:52.226538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:52.227610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:52.228910 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:52.236792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:52.237795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:52.512826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:52.525054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:52.527958 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:52.530171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-95defe01-d35a-4970-b147-831c5d5e1059 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.317239 Sep 10 14:22:52.530769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 517/1036] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:52 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:52.930537 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-a0f3c607-4bea-4c53-8111-dbbdd1316c98 req-6b5df72d-6862-4d9f-b23e-3c9eae84b1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437bb55d-e31b-46f6-9dd1-d1aedf7cd370", "name": "network-vif-deleted", "tag": "810f325f-bbb0-4176-bccf-7cadda251d29"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:52.936663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:22:52.957982 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-a0f3c607-4bea-4c53-8111-dbbdd1316c98 req-6b5df72d-6862-4d9f-b23e-3c9eae84b1b7 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:52.961617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-a0f3c607-4bea-4c53-8111-dbbdd1316c98 req-6b5df72d-6862-4d9f-b23e-3c9eae84b1b7 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:52.962513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-a0f3c607-4bea-4c53-8111-dbbdd1316c98 req-6b5df72d-6862-4d9f-b23e-3c9eae84b1b7 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:52.987634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-a0f3c607-4bea-4c53-8111-dbbdd1316c98 req-6b5df72d-6862-4d9f-b23e-3c9eae84b1b7 service nova] Creating event network-vif-deleted:810f325f-bbb0-4176-bccf-7cadda251d29 for instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 on hv-cinder-85690 Sep 10 14:22:52.994720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-a0f3c607-4bea-4c53-8111-dbbdd1316c98 req-6b5df72d-6862-4d9f-b23e-3c9eae84b1b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067987 Sep 10 14:22:52.995975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 520/1037] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:22:53.055099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:53.056535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:53.072333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:53.073115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:53.073727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:53.074809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:53.075578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:53.076274 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:53.114224 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:53.116108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:53.116859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:53.117968 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lazy-loading 'fault' on Instance uuid 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:22:53.170291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993bf8937c8349e7887b3825a7034367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6109b45e7ff14addb54c4bff4fb43df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:53.181218 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a664ae8a-9664-4d7c-9990-574dafefba98 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 200 len: 1348 microversion: 2.1 time: 0.130984 Sep 10 14:22:53.183366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 518/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:53 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 1348 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:22:53.561970 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:53.562909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:53.569595 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:53.570066 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:53.570647 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:53.571370 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:53.571873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:53.572324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:53.727009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:53.743998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:53.745461 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:53.746639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d7977a97-ce1b-4f4f-b929-374cf97d3a29 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.190880 Sep 10 14:22:53.766111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 521/1039] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:53 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:54.212753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:54.213376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] [instance: 437bb55d-e31b-46f6-9dd1-d1aedf7cd370] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:54.232932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:54.233720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:54.234349 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:54.235264 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:54.235910 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:54.236486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:54.264183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] HTTP exception thrown: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 could not be found. Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Request method failure captured: Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 HTTP/1.1 Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJzFI-Q729-Hh1C1TkiMz6lgwGvekgXv0eLmRrPyvfO_E9Gx8owLuUX-MSaAT21gKr3DnvtjLbYxtbcKjRIk-3U8ct6D2gH-0oZ_8_wRhGQtcPd5lOSxY4W5LmsKYFxHwLOGCouRe6ihywJEExb8XGo4vNuPQki755k9dt1uuCgHGOY Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 6109b45e7ff14addb54c4bff4fb43df6 Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestMinimumBasicScenario-1248620484 Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:22:54.266856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6109b45e7ff14addb54c4bff4fb43df6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6109b45e7ff14addb54c4bff4fb43df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6109b45e7ff14addb54c4bff4fb43df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6109b45e7ff14addb54c4bff4fb43df6"}]}] Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestMinimumBasicScenario-1248620484 Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 6109b45e7ff14addb54c4bff4fb43df6 Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1248620484 Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestMinimumBasicScenario-1248620484-project Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 993bf8937c8349e7887b3825a7034367 Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestMinimumBasicScenario-1248620484-project Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 could not be found. Sep 10 14:22:54.268582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '437bb55d-e31b-46f6-9dd1-d1aedf7cd370'} Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 could not be found. Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:22:54.269511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 could not be found. Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 could not be found. Sep 10 14:22:54.270790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:22:54.272641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Returning 404 to user: Instance 437bb55d-e31b-46f6-9dd1-d1aedf7cd370 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:22:54.273642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2f60bd37-6baa-4c9e-84c1-acd66bc46e6f tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370" status: 404 len: 111 microversion: 2.1 time: 0.064725 Sep 10 14:22:54.274311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 519/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:22:54 2022] GET /compute/v2.1/servers/437bb55d-e31b-46f6-9dd1-d1aedf7cd370 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:22:54.283181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b0b98fc9-cc6d-4915-bc3f-8da044413f92 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] Calling method '.version_select at 0x7ff6b720f9d0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:54.303978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b0b98fc9-cc6d-4915-bc3f-8da044413f92 tempest-TestMinimumBasicScenario-1248620484 tempest-TestMinimumBasicScenario-1248620484-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1874082818" status: 202 len: 0 microversion: 2.1 time: 0.025039 Sep 10 14:22:54.304955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 522/1041] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 10 14:22:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1874082818 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 14:22:54.774050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:54.775029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:54.783834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:54.784597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:54.785360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:54.786283 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:54.786815 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:54.787317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:54.936782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:54.946769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:54.949768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:54.951011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-25de98c5-42bb-4671-bb1b-8591a03e1aac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.181182 Sep 10 14:22:54.952906 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 520/1042] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:54 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:55.978681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:55.980107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:55.988543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:55.989397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:55.989916 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:55.990709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:55.991255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:55.991784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:56.146476 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:56.154710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:56.156227 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:56.158115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-89462c91-7775-45e4-8a91-1ac4070bb447 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.183578 Sep 10 14:22:56.158678 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 523/1043] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:55 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:57.184260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:57.185455 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:57.193257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:57.193773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:57.194206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:57.194925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:57.195580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:57.196071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:57.417885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:57.430439 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:57.431953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:57.433145 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f67c563a-ec2a-4965-ae0c-1c29668a07d6 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1741 microversion: 2.20 time: 0.253077 Sep 10 14:22:57.433890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 521/1044] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:57 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:22:58.458448 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:58.459066 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:58.476388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:58.476967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:58.477482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:58.478259 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:58.478792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:58.479291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:58.660939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:58.670167 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:58.672271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:58.673920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7e27cf93-4cf9-4821-8bf8-2259f0922ae9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1723 microversion: 2.20 time: 0.219425 Sep 10 14:22:58.674566 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 524/1045] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:58 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:59.702183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:22:59.703901 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:22:59.710583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:59.711190 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:59.711770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:59.712590 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:59.713314 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:59.713840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:59.872125 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-7c4122ba-2cd4-4560-af4c-201dc3227670 req-32c2ac5c-17c1-459c-a4f1-bd3981f1bf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "name": "network-vif-unplugged", "status": "completed", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:22:59.877007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:59.887315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:59.887514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-7c4122ba-2cd4-4560-af4c-201dc3227670 req-32c2ac5c-17c1-459c-a4f1-bd3981f1bf34 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:22:59.888140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-7c4122ba-2cd4-4560-af4c-201dc3227670 req-32c2ac5c-17c1-459c-a4f1-bd3981f1bf34 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:22:59.888802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:22:59.890418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4478d333-1f1d-49f8-be09-205f1eee9f32 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1723 microversion: 2.20 time: 0.192576 Sep 10 14:22:59.890546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-7c4122ba-2cd4-4560-af4c-201dc3227670 req-32c2ac5c-17c1-459c-a4f1-bd3981f1bf34 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:22:59.892310 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 522/1046] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:22:59 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:22:59.924064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-7c4122ba-2cd4-4560-af4c-201dc3227670 req-32c2ac5c-17c1-459c-a4f1-bd3981f1bf34 service nova] Creating event network-vif-unplugged:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:22:59.929119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-7c4122ba-2cd4-4560-af4c-201dc3227670 req-32c2ac5c-17c1-459c-a4f1-bd3981f1bf34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063978 Sep 10 14:22:59.930140 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 525/1047] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:23:00.922591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:00.923214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:00.930258 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:00.930762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:00.931229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:00.932034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:00.932494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:00.932932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:01.082948 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:01.091992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:01.093443 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:01.095221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a0b4a6aa-cbf1-48b8-9425-f2c6c0f14181 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1723 microversion: 2.20 time: 0.177051 Sep 10 14:23:01.095809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 523/1048] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:00 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:02.124120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:02.124912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:02.131685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:02.132990 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:02.133438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:02.134152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:02.134761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:02.135206 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:02.346093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:02.354199 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:02.355645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:02.356819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4dd4e4cd-49fc-48be-bba3-6b4ef5663442 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1666 microversion: 2.20 time: 0.238670 Sep 10 14:23:02.357386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 526/1049] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:02 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1666 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:02.384481 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a69ab853-71d1-4d01-ba0f-69bc537555b9"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:02.386927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:02.394321 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:02.394892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:02.395400 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:02.396198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:02.396736 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:02.397229 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:02.606695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:02.720793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e4a47004-11bf-48db-a27f-f84b70ff580e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.340217 Sep 10 14:23:02.722065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 524/1050] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Sep 10 14:23:02 2022] POST /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 14:23:02.875292 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:02.876261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:02.882391 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:02.883655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:02.884246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:02.885453 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:02.885932 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:02.886360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:03.160702 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-17883da5-9f8c-4202-b3a3-6c19f3479e4d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-volume_attachments/a69ab853-71d1-4d01-ba0f-69bc537555b9" status: 202 len: 0 microversion: 2.20 time: 0.289900 Sep 10 14:23:03.161704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 527/1051] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Sep 10 14:23:02 2022] DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-volume_attachments/a69ab853-71d1-4d01-ba0f-69bc537555b9 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:23:03.237734 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:03.238431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:03.245608 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:03.246138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:03.246653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:03.247426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:03.247996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:03.248511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:03.278944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120616) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 14:23:03.347203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-990b4008-f958-4311-9cd7-c198a290b4f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "POST /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/action" status: 202 len: 0 microversion: 2.20 time: 0.113705 Sep 10 14:23:03.347854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 525/1052] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 10 14:23:03 2022] POST /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:23:03.356137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:03.356756 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:03.358744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:03.366714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:03.367346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:03.367954 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:03.368767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:03.369184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:03.369598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:03.634961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:03.648020 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:03.651157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:03.652874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-df6a71dd-3c1a-424e-a6aa-1b6dab075859 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1674 microversion: 2.20 time: 0.300463 Sep 10 14:23:03.653776 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 528/1053] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:03 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1674 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:04.680160 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:04.680956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:04.687312 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:04.688351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:04.688787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:04.689487 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:04.689939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:04.690354 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:04.974060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:04.982346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:04.983820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:04.985556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-195c6f0b-4b91-4035-9054-43a767b05e8b tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.309968 Sep 10 14:23:04.986236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 526/1054] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:04 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:23:06.017180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:06.017798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:06.024974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:06.025472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:06.025909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:06.026611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:06.027070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:06.027528 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:06.266754 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:06.282452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:06.284449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:06.286067 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-86ae0ada-76f5-4405-8bce-127ed5d4b07f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.275344 Sep 10 14:23:06.287262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 529/1055] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:06 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:07.318056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:07.320035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:07.340781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:07.341331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:07.341915 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:07.342856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:07.343206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:07.343845 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:07.569918 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:07.581070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:07.583706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:07.586833 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-35d02b83-f9f0-4122-b6f9-2f7d3927990f tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.273903 Sep 10 14:23:07.612860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 527/1056] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:07 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:08.622057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:08.622735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:08.631727 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:08.632495 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:08.633635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:08.634428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:08.634970 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:08.635628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:08.923880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:08.934170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:08.936607 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:08.938905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3001cef2-34c2-4086-8b73-c88da516958e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.321366 Sep 10 14:23:08.940122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 530/1057] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:08 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:09.973085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:09.975319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:09.989805 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:09.990569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:09.991311 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:09.992356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:09.992973 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:09.993642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:10.195702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:10.205775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:10.209733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:10.216897 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b6e9f748-2b13-4a0d-be81-7c3a3b0d32da tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.250861 Sep 10 14:23:10.232147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 528/1058] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:09 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:10.508583 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1651068714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1666901075", "security_groups": [{"name": "tempest-secgroup-smoke-1642103404"}], "block_device_mapping_v2": [{"uuid": "cb7fd7c6-d6fd-45a5-907c-0ad57d0ef5d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "50038936-7823-499b-a2d7-942d23b9f352"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:10.730819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] validate_networks() for [('50038936-7823-499b-a2d7-942d23b9f352', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:23:11.267473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:11.268100 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:11.288071 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:11.289056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:11.290547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:11.294500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:11.295207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:11.296053 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:11.332208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:23:11.332770 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:23:11.333333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:23:11.333864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:23:11.334355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:23:11.362682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:11.363388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:11.365660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:11.366884 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:11.367719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:11.369705 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:11.426889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:23:11.440090 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for user f4638a1936f5467db502bda82320b113 and project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:23:11.590864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:23:11.595045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb7fd7c6-d6fd-45a5-907c-0ad57d0ef5d5',volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:23:11.733170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:11.744764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:11.746198 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:11.747381 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1fa096e4-eb41-4175-87d5-850f8e9bdbf9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.487570 Sep 10 14:23:11.767085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 529/1059] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:11 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:11.860258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-220ee343-816f-4e69-8744-7f9423cb16c6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.354872 Sep 10 14:23:11.861762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 531/1060] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:23:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:23:11.880055 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f1e67da9-3c43-4ecb-948c-e512b4d5b9f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:11.881082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f1e67da9-3c43-4ecb-948c-e512b4d5b9f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:12.003753 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f1e67da9-3c43-4ecb-948c-e512b4d5b9f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:12.014925 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f1e67da9-3c43-4ecb-948c-e512b4d5b9f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1095 microversion: 2.1 time: 0.144336 Sep 10 14:23:12.018642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 530/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:11 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1095 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:12.787039 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:12.787718 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:12.799686 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:12.800522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:12.801266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:12.802242 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:12.802936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:12.803683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:12.824249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:13.012835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:13.026452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:13.029198 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:13.031360 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-27e4808b-a956-42fb-9d06-aee3baed273a tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.250061 Sep 10 14:23:13.032164 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 532/1062] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:12 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:13.052857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:13.054109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:13.060284 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:13.063760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:13.071803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:13.072576 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:13.073054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:13.073489 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:13.202764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:13.212394 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9bf8cb3c-a8d6-4854-b268-55a1198bd11f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.175659 Sep 10 14:23:13.214807 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 531/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:13 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:14.057504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:14.058132 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:14.066300 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:14.066794 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:14.067223 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:14.067955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:14.068408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:14.068826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:14.235048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:14.236411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:14.244551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:14.245344 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:14.245941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:14.246883 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:14.247563 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:14.248212 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:14.324852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:14.334662 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0c3908e8-36ee-40d8-9a23-91f74ae887b1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.104180 Sep 10 14:23:14.335243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 532/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:14 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:14.365771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:14.375626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:14.377851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:14.379477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7c57bb67-3795-43f6-adbf-b6ea974cb9f7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.326601 Sep 10 14:23:14.395762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 533/1065] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:14 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:15.358359 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:15.358982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:15.367562 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:15.370358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:15.370979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:15.372240 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:15.375603 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:15.376240 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:15.407079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:15.408770 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:15.438662 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:15.440938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:15.441661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:15.443692 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:15.447070 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:15.447820 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:15.641792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:15.654242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a0bdd447-7e8f-4e0a-aeb7-eb623c6a0730 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.299171 Sep 10 14:23:15.677615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 533/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:15 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:15.745995 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:15.767667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:15.769303 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:15.773194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e26e13b4-db15-4887-8b0f-a58d3d9d140d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.370717 Sep 10 14:23:15.777475 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 534/1067] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:15 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:16.692164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:16.695436 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:16.705952 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:16.706830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:16.707583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:16.708561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:16.709244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:16.709890 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:16.803252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:16.812714 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:16.825101 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:16.826653 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:16.826771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:16.827953 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:16.828517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:16.829124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:16.849220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:16.859498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6187f908-650e-4613-9b8f-b5e1ad296049 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.172900 Sep 10 14:23:16.860669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 534/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:16 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:17.019151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:17.028157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:17.029709 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:17.031738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b1aa2863-aa5a-498c-b45c-09a3cc08a48e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.233161 Sep 10 14:23:17.032895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 535/1069] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:16 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:23:17.888507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:17.890040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:17.899882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:17.900700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:17.902379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:17.903426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:17.904300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:17.907064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:18.002553 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:18.016413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e367b622-5c64-43d7-a523-078afc3fe4c5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.134004 Sep 10 14:23:18.017203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 535/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:17 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:18.061831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:18.063285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:18.075263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:18.076873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:18.077334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:18.078611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:18.079103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:18.079561 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:18.329635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:18.338812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:18.340680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:18.341991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e464e33e-f6fe-4a57-8c28-2a9411fb8f68 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.284090 Sep 10 14:23:18.342642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 536/1071] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:18 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:19.040731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:19.041364 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:19.048930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:19.049704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:19.051273 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:19.052288 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:19.053114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:19.053743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:19.148455 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:19.159139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3c8e0d5e-b264-4d7b-93f2-ea7be6583cb9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.123663 Sep 10 14:23:19.172144 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 536/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:19 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:19.343257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ca142235-51a8-4277-9ad8-f3f6ecc4ffc6 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Action: 'create', calling method: .version_select at 0x7ff6b7271c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1695897523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrf+DEW+HvZwyFLWV1M0tuasm4h2vvs2vIYoxtIFmaxI+uZEgreYtQI80EAkskegmdWcUv1ncd3rYVkq3/6IIc6wHFWYLfR9vyPDIqeEEc8Vnt2MQVfe3rLYjtRVlXXOA=="}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:19.360083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-ca142235-51a8-4277-9ad8-f3f6ecc4ffc6 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Getting quotas for project b4ebb6e9554f4c0d985bf90411a4e36f. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:23:19.369133 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:19.369808 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:19.373683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-ca142235-51a8-4277-9ad8-f3f6ecc4ffc6 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Getting quotas for user b13d21124dbf41459543426847b67bea and project b4ebb6e9554f4c0d985bf90411a4e36f. Resources: {'key_pairs'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:23:19.376514 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:19.377078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:19.377580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:19.378356 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:19.378876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:19.379391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:19.400282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ca142235-51a8-4277-9ad8-f3f6ecc4ffc6 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.282045 Sep 10 14:23:19.401672 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 537/1073] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 10 14:23:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:19.531715 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:19.541050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:19.542498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:19.543867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6007a82f-58e5-4516-bf17-8743d7a1b827 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.178525 Sep 10 14:23:19.544427 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 537/1074] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:19 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:20.185731 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:20.186578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:20.194479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:20.195114 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:20.195613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:20.196334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:20.196920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:20.197535 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:20.270821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:20.284593 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1ca8d691-ad55-4efb-854c-bd1a321a852c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.103475 Sep 10 14:23:20.285177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 538/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:20 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:20.574069 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:20.574714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:20.581561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:20.582116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:20.582623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:20.583387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:20.583965 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:20.584451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:20.750631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:20.762277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:20.763934 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:20.765831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3c993c0f-43c0-4e6d-b7f4-7b652fc2f8b9 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.194925 Sep 10 14:23:20.785526 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 538/1076] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:20 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:23:21.308230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:21.308843 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:21.317743 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:21.318368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:21.318842 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:21.319594 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:21.320307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:21.320764 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:21.392365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:21.398235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:21.401148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-06f607ce-2fcd-4f9e-9920-2ca2694292f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.096843 Sep 10 14:23:21.401664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 539/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:21 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:21.793038 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:21.793762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:21.800902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:21.801387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:21.801818 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:21.802510 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:21.802979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:21.803503 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:21.962193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:21.972197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:21.973940 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:21.975271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-91050948-ef90-494c-9cc2-7ba1504a3b88 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.186060 Sep 10 14:23:21.975893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 539/1078] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:21 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:22.424347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:22.424998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:22.432683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:22.433543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:22.433980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:22.434855 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:22.435319 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:22.435886 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:22.504617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:22.512635 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-161176e7-9614-4071-bb0a-2e39e4b92e95 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1145 microversion: 2.1 time: 0.093006 Sep 10 14:23:22.513205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 540/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:22 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:22.999720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:23.006003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:23.006639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:23.013615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:23.015912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:23.016417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:23.016859 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:23.017574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:23.018036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:23.018468 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:23.038106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SELECT=94 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:23.184215 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:23.193978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:23.195432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:23.196637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1f9e7353-22cc-4280-b183-63a4e1405b3e tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.197973 Sep 10 14:23:23.197200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 540/1080] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:22 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:23:23.536974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:23.538473 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:23.545395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:23.546289 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:23.548343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:23.549489 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:23.550142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:23.550921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:23.629592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:23.637630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-32df71aa-be3c-41a3-8226-a3b32e13e704 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1193 microversion: 2.1 time: 0.104574 Sep 10 14:23:23.638355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 541/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:23 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:24.223661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:24.224258 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:24.233247 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:24.233766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:24.235025 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:24.235769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:24.236220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:24.237170 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:24.457907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:24.473864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:24.476042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:24.477491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cd81386e-8c67-4eae-b3b4-d2e94e211af3 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.257999 Sep 10 14:23:24.478295 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 541/1082] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:24 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:23:24.663478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:24.664999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:24.671716 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:24.672551 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:24.673504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:24.674722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:24.675564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:24.676240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:24.845480 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:24.856386 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4661b922-3864-4c53-b6bd-a5daa6a8c9db tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.196839 Sep 10 14:23:24.856965 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 542/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:24 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:25.289875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-4204225d-c02f-4127-866c-73658a380ccc req-c9be4021-d1cc-415e-87fb-5f21b81324e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7469fb7b-1361-4524-9eba-6ef556a22815", "tag": "71816fb4-ad1f-4ea4-be98-351d115e688c"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:25.301287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-4204225d-c02f-4127-866c-73658a380ccc req-c9be4021-d1cc-415e-87fb-5f21b81324e3 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:25.301720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-4204225d-c02f-4127-866c-73658a380ccc req-c9be4021-d1cc-415e-87fb-5f21b81324e3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:25.302183 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-4204225d-c02f-4127-866c-73658a380ccc req-c9be4021-d1cc-415e-87fb-5f21b81324e3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:25.314972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-4204225d-c02f-4127-866c-73658a380ccc req-c9be4021-d1cc-415e-87fb-5f21b81324e3 service nova] Creating event network-changed:71816fb4-ad1f-4ea4-be98-351d115e688c for instance 7469fb7b-1361-4524-9eba-6ef556a22815 on hv-cinder-85690 Sep 10 14:23:25.319815 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-4204225d-c02f-4127-866c-73658a380ccc req-c9be4021-d1cc-415e-87fb-5f21b81324e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033660 Sep 10 14:23:25.320773 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 542/1084] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:23:25.506739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:25.507395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:25.513471 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:25.514205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:25.514645 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:25.515385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:25.515867 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:25.516385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:25.654672 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:25.663964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:25.665425 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:25.666749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ad043b99-298e-4266-9a16-56e2757d1054 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.163853 Sep 10 14:23:25.667644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 543/1085] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:25 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:25.881583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:25.882466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:25.889375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:25.889875 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:25.890395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:25.891115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:25.891605 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:25.892046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:25.935824 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-51942dcd-47fe-41a8-933d-83a7e791d09d req-9287adc3-dd9d-4153-b778-c63ecf7816f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "name": "network-vif-plugged", "status": "completed", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:25.952148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-51942dcd-47fe-41a8-933d-83a7e791d09d req-9287adc3-dd9d-4153-b778-c63ecf7816f8 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:25.953301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-51942dcd-47fe-41a8-933d-83a7e791d09d req-9287adc3-dd9d-4153-b778-c63ecf7816f8 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:25.953957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-51942dcd-47fe-41a8-933d-83a7e791d09d req-9287adc3-dd9d-4153-b778-c63ecf7816f8 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:25.965407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-51942dcd-47fe-41a8-933d-83a7e791d09d req-9287adc3-dd9d-4153-b778-c63ecf7816f8 service nova] Creating event network-vif-plugged:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:23:25.972264 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-51942dcd-47fe-41a8-933d-83a7e791d09d req-9287adc3-dd9d-4153-b778-c63ecf7816f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040220 Sep 10 14:23:25.973427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 544/1086] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:26.041200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:26.050099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2df3ce9e-e79c-4acc-bfa2-25e464395cab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.173381 Sep 10 14:23:26.050713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 543/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:25 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:26.692368 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:26.693056 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:26.699166 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:26.699674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:26.700105 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:26.700779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:26.701228 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:26.701644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:26.752509 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:26.753138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:26.763726 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:26.764378 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:26.764830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:26.766099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:26.766560 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:26.767545 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:26.801024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f9633ce1-256d-4946-ac8e-b055201a7ebe tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/ips" status: 200 len: 146 microversion: 2.1 time: 0.052390 Sep 10 14:23:26.810765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 544/1088] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:23:26 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:23:26.858640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:26.876265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:26.878163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:26.879630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-59a736df-c254-48e7-8c99-9cccf10de9be tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.191724 Sep 10 14:23:26.880772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 545/1089] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:26 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:27.073657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:27.074287 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:27.083160 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:27.084675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:27.085476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:27.086549 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:27.087024 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:27.087482 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:27.229610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:27.237317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4bce44b1-5fda-4abb-a8d8-3d12f941eaf8 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.167898 Sep 10 14:23:27.237903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 545/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:27 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:27.911252 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:27.911839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:27.918389 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:27.918873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:27.919308 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:27.920027 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:27.920484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:27.920905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:28.057129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:28.065772 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:28.067205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:28.068406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-adfb2053-9ced-4afe-9b11-45fdf62e7cea tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.161268 Sep 10 14:23:28.068961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 546/1091] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:27 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:28.224837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5089b81-4121-4cef-8f5c-28e1c97b0c76"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:28.227214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:28.234472 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:28.234972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:28.235625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:28.236427 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:28.237082 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:28.237800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:28.261539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:28.262484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:28.272017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:28.272380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:28.273152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:28.274077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:28.274546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:28.274976 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:28.448247 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:28.460592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-19bfb6a3-0f15-441c-b961-29b358acbbfd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.203179 Sep 10 14:23:28.461220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 547/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:28 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:28.574729 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bc597229-ea6c-4efc-9856-813964fef2b5 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353774 Sep 10 14:23:28.575336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 546/1093] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:23:28 2022] POST /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:23:29.094930 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:29.095470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:29.102218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:29.102721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:29.103167 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:29.103922 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:29.104381 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:29.104808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:29.250697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:29.263411 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:29.265589 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:29.268136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-eda49e3a-2c40-4e55-bb84-76ce2a66f531 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1732 microversion: 2.20 time: 0.177255 Sep 10 14:23:29.268730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 548/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:29 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:29.484903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:29.485611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:29.492119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:29.492599 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:29.493031 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:29.493713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:29.494166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:29.494580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:29.639520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:29.653158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b0b21fd4-5dc6-484c-9a98-808fbcd4bc56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.173234 Sep 10 14:23:29.653946 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 547/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:29 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:30.295251 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:30.295887 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:30.297933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=10 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:30.304722 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:30.305604 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:30.306410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:30.307717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:30.308556 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:30.309269 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:30.447860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:30.457452 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:30.459018 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:30.460388 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9dd9b044-e4d3-4fb6-b1ae-52b3827e5110 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1719 microversion: 2.20 time: 0.169272 Sep 10 14:23:30.460958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 549/1096] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:23:30 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:23:30.676830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:30.677441 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:30.683949 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:30.684422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:30.684848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:30.685529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:30.685983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:30.686403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:30.821248 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:30.829537 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-35f563c8-de81-49af-8679-51394681f44d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.156628 Sep 10 14:23:30.830096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 548/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:30 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:31.852889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:31.853504 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:31.860428 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:31.860840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:31.861290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:31.861993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:31.862461 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:31.862897 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:32.099821 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:32.103157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=100 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:32.108407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f7fb1107-877a-428b-baf4-9f8b308975ec tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.259394 Sep 10 14:23:32.108966 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 550/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:31 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:33.132683 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:33.133244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:33.139706 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:33.140206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:33.140625 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:33.141353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:33.141766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:33.142191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:33.328391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:33.336438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6b3ce648-aa46-4224-b250-cc46e7f52627 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.207681 Sep 10 14:23:33.336997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 549/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:33 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:34.359634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:34.360515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:34.363057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:34.368543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:34.369023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:34.369453 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:34.370131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:34.370578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:34.370994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:34.503533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:34.511137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d96207f0-e366-407e-8a11-d5d85675fd08 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.155411 Sep 10 14:23:34.511724 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 551/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:34 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:35.534078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:35.534702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:35.541220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:35.541711 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:35.542153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:35.542846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:35.543303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:35.543762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:35.682251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:35.690202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-16c90181-e453-441c-8f7d-86f2fcc9be17 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.160607 Sep 10 14:23:35.690770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 550/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:35 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:36.712841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:36.713455 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:36.720454 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:36.720925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:36.721359 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:36.722052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:36.722505 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:36.722928 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:36.857151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:36.865275 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-657dbf27-a2b3-401c-ae0d-c3a0542b1f35 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.156628 Sep 10 14:23:36.865841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 552/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:36 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:37.192887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:37.195132 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:37.201530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:37.202019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:37.202462 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:37.203152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:37.204177 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:37.204604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:37.234357 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b42dc872-3d08-4d01-9a70-0d636d440661 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Sep 10 14:23:37.234995 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 551/1103] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:23:37 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:37.246042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:37.246539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:37.252547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:37.253028 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:37.253462 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:37.254148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:37.254598 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:37.255024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:37.284992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b29ec779-22f7-4675-bd64-66e06f94c00c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/e5089b81-4121-4cef-8f5c-28e1c97b0c76" status: 200 len: 194 microversion: 2.1 time: 0.042873 Sep 10 14:23:37.285584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 553/1104] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Sep 10 14:23:37 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/e5089b81-4121-4cef-8f5c-28e1c97b0c76 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:37.888389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:37.889036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:37.895118 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:37.895651 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:37.896089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:37.896779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:37.897238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:37.897664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:38.032228 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:38.040219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-34959731-5ec4-4023-98cf-8a0e08ec430f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.155661 Sep 10 14:23:38.040781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 552/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:37 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:38.325254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-21d0f661-cbfe-4445-a55b-7036deb6db07 req-908c19ef-b3b3-409c-b8ff-2ad723465020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7469fb7b-1361-4524-9eba-6ef556a22815", "name": "network-vif-plugged", "status": "completed", "tag": "71816fb4-ad1f-4ea4-be98-351d115e688c"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:38.336035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-21d0f661-cbfe-4445-a55b-7036deb6db07 req-908c19ef-b3b3-409c-b8ff-2ad723465020 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:38.336519 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-21d0f661-cbfe-4445-a55b-7036deb6db07 req-908c19ef-b3b3-409c-b8ff-2ad723465020 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:38.336951 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-21d0f661-cbfe-4445-a55b-7036deb6db07 req-908c19ef-b3b3-409c-b8ff-2ad723465020 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:38.348211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-21d0f661-cbfe-4445-a55b-7036deb6db07 req-908c19ef-b3b3-409c-b8ff-2ad723465020 service nova] Creating event network-vif-plugged:71816fb4-ad1f-4ea4-be98-351d115e688c for instance 7469fb7b-1361-4524-9eba-6ef556a22815 on hv-cinder-85690 Sep 10 14:23:38.353069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-21d0f661-cbfe-4445-a55b-7036deb6db07 req-908c19ef-b3b3-409c-b8ff-2ad723465020 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031920 Sep 10 14:23:38.353660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 554/1106] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:39.063276 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:39.064104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:39.070397 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:39.070877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:39.071316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:39.072036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:39.072488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:39.072907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:39.206529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:39.214294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-663d893c-9100-4769-a8fe-eb9d0c2a9ad7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.155458 Sep 10 14:23:39.214847 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 553/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:39 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:39.665548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25b44842-337c-4f94-b60b-9b1661d5ba9b"}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:39.668089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:39.674843 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:39.675323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:39.675779 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:39.676460 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:39.676910 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:39.677331 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:40.220086 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-dbc00e96-cfd4-4099-af3b-faee48ab285e tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "POST /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558999 Sep 10 14:23:40.220690 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 555/1108] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:23:39 2022] POST /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:40.239857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:40.240606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:40.247822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:40.248318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:40.248757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:40.249463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:40.249921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:40.250393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:40.387760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:40.395700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9fddc25f-41e1-4e74-a50e-1a32fd6731c9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1267 microversion: 2.1 time: 0.160915 Sep 10 14:23:40.396268 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 554/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:40 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:41.419265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:41.419994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:41.426374 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:41.426888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:41.427325 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:41.428038 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:41.428492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:41.428917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:41.570557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:41.578362 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-76b02cd8-125d-449b-81e7-57520d316cdb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1454 microversion: 2.1 time: 0.163961 Sep 10 14:23:41.578898 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 556/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:41 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:41.601778 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:41.602431 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:41.609157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:41.609653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:41.610064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:41.610748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:41.611458 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:41.611982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:41.744640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:41.753216 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f4888f8c-38fd-4752-8fc2-b08cdc35e939 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1454 microversion: 2.1 time: 0.155763 Sep 10 14:23:41.753784 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 555/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:41 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:43.444667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-9c6d3a34-fa1f-418f-bc44-4e219c22a0ee req-cc35eb5e-2c3d-43a8-be61-95a55fc1f7bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7469fb7b-1361-4524-9eba-6ef556a22815", "tag": "71816fb4-ad1f-4ea4-be98-351d115e688c"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:43.457085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-9c6d3a34-fa1f-418f-bc44-4e219c22a0ee req-cc35eb5e-2c3d-43a8-be61-95a55fc1f7bd service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:43.457574 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-9c6d3a34-fa1f-418f-bc44-4e219c22a0ee req-cc35eb5e-2c3d-43a8-be61-95a55fc1f7bd service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:43.458030 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-9c6d3a34-fa1f-418f-bc44-4e219c22a0ee req-cc35eb5e-2c3d-43a8-be61-95a55fc1f7bd service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:43.469682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-9c6d3a34-fa1f-418f-bc44-4e219c22a0ee req-cc35eb5e-2c3d-43a8-be61-95a55fc1f7bd service nova] Creating event network-changed:71816fb4-ad1f-4ea4-be98-351d115e688c for instance 7469fb7b-1361-4524-9eba-6ef556a22815 on hv-cinder-85690 Sep 10 14:23:43.480009 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-9c6d3a34-fa1f-418f-bc44-4e219c22a0ee req-cc35eb5e-2c3d-43a8-be61-95a55fc1f7bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040853 Sep 10 14:23:43.480933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 557/1112] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:44.232016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1743528462", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1695897523", "security_groups": [{"name": "tempest-secgroup-smoke-1940832366"}], "networks": [{"uuid": "0a613211-9c8e-4cc1-915e-35b39175cad0"}], "block_device_mapping_v2": [{"uuid": "2ca238b6-d6ba-491d-b57f-a0c774cbb14c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:44.350840 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] validate_networks() for [('0a613211-9c8e-4cc1-915e-35b39175cad0', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:23:44.775239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:23:44.775719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:23:44.776194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:23:44.776600 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:23:44.777007 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:23:44.786629 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:44.787106 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:44.787574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:44.788291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:44.788743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:44.789157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:44.807474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Getting quotas for project b4ebb6e9554f4c0d985bf90411a4e36f. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:23:44.811386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Getting quotas for user b13d21124dbf41459543426847b67bea and project b4ebb6e9554f4c0d985bf90411a4e36f. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:23:44.870945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:23:44.873074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ca238b6-d6ba-491d-b57f-a0c774cbb14c',volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:23:45.007737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e43a7dba-1cf4-4487-b30e-173b11fa57ee tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779394 Sep 10 14:23:45.008492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 556/1113] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:23:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:23:45.020477 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-806e2e60-8cfc-4dea-9be0-6767e91ad78d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:45.021185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-806e2e60-8cfc-4dea-9be0-6767e91ad78d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:45.087405 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-806e2e60-8cfc-4dea-9be0-6767e91ad78d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:45.094536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-806e2e60-8cfc-4dea-9be0-6767e91ad78d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1089 microversion: 2.1 time: 0.078796 Sep 10 14:23:45.095811 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 558/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:45 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:46.118820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:46.119347 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:46.126101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:46.127241 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:46.127879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:46.128574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:46.129026 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:46.129448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:46.145844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:46.196876 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:46.204652 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-fb8f22d4-0855-4ce4-8d14-9a48a389d79b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1187 microversion: 2.1 time: 0.090482 Sep 10 14:23:46.205606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 557/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:46 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:47.228163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:47.229436 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:47.237746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:47.238243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:47.238682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:47.239652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:47.240182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:47.240532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:47.388819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:47.410064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bb1d7561-1cb4-48e6-98fa-96469914f95e tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1273 microversion: 2.1 time: 0.185846 Sep 10 14:23:47.410650 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 559/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:47 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:48.060795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-9e97601d-467f-4949-a66f-f82f0fc9a1a6 req-3dfeef70-7d5c-4de5-987c-6cbe11288972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:48.071386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-9e97601d-467f-4949-a66f-f82f0fc9a1a6 req-3dfeef70-7d5c-4de5-987c-6cbe11288972 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:48.072047 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-9e97601d-467f-4949-a66f-f82f0fc9a1a6 req-3dfeef70-7d5c-4de5-987c-6cbe11288972 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:48.072663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-9e97601d-467f-4949-a66f-f82f0fc9a1a6 req-3dfeef70-7d5c-4de5-987c-6cbe11288972 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:48.085704 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-9e97601d-467f-4949-a66f-f82f0fc9a1a6 req-3dfeef70-7d5c-4de5-987c-6cbe11288972 service nova] Creating event network-changed:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:23:48.091249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-9e97601d-467f-4949-a66f-f82f0fc9a1a6 req-3dfeef70-7d5c-4de5-987c-6cbe11288972 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034744 Sep 10 14:23:48.091885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 558/1117] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:48.436224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:48.436813 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:48.443941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:48.444431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:48.444869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:48.445664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:48.446124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:48.446547 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:48.622651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:48.630637 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bb841c75-f079-4b38-ada3-66f57578fa2b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1273 microversion: 2.1 time: 0.198434 Sep 10 14:23:48.631209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 560/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:48 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:48.862645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:48.865502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:48.872235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:48.872725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:48.873157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:48.873892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:48.874338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:48.874756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:48.909105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1108ae9e-dfab-4d96-8794-1ba738a4c12a tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052727 Sep 10 14:23:48.909700 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 559/1119] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:23:48 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:49.054151 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:49.054568 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:49.060688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:49.061194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:49.061643 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:49.062350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:49.062823 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:49.063243 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:49.096543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-70f4aa06-cf86-4ee1-be6a-0b23e8bc18f1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/e5089b81-4121-4cef-8f5c-28e1c97b0c76" status: 200 len: 194 microversion: 2.1 time: 0.046650 Sep 10 14:23:49.097159 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 561/1120] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Sep 10 14:23:49 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/e5089b81-4121-4cef-8f5c-28e1c97b0c76 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:23:49.108023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:49.108568 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:49.116508 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:49.117002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:49.117443 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:49.118153 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:49.118661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:49.119098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:49.212930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lazy-loading 'services' on Instance uuid c4453e93-3061-4fe5-a24d-a9c6c963aa90 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:23:49.291257 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0a37dc4a-6c3f-4554-b63f-1a30fa9b55ae tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/e5089b81-4121-4cef-8f5c-28e1c97b0c76" status: 202 len: 0 microversion: 2.1 time: 0.187099 Sep 10 14:23:49.292085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 560/1121] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:23:49 2022] DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/e5089b81-4121-4cef-8f5c-28e1c97b0c76 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:23:49.654100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:49.654648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:49.662048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:49.662530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:49.662962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:49.663723 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:49.664177 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:49.664627 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:49.793482 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:49.801757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-32e43a4b-3592-4ad4-97fc-15081f5cd0c0 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.151592 Sep 10 14:23:49.802314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 562/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:49 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:50.824916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:50.825616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:50.832900 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:50.833387 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:50.834013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:50.834721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:50.835175 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:50.835631 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:51.015846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:51.023656 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-264fe5be-891c-45bc-90aa-beabf333f42f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.202886 Sep 10 14:23:51.024221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 561/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:50 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:52.046767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:52.047390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:52.055738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:52.056244 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:52.056679 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:52.057377 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:52.057830 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:52.058253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:52.202962 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:52.216068 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-310b982d-bb8a-46ca-9010-46127d5f90a2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.172779 Sep 10 14:23:52.217111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 563/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:52 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:52.549494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:52.549992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:52.556909 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:52.557426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:52.557865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:52.558561 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:52.559020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:52.559467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:52.589413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6b26e3c8-67d8-412a-a386-b97968f2e452 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/25b44842-337c-4f94-b60b-9b1661d5ba9b" status: 200 len: 194 microversion: 2.1 time: 0.044035 Sep 10 14:23:52.589994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 562/1125] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Sep 10 14:23:52 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/25b44842-337c-4f94-b60b-9b1661d5ba9b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:52.600795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:52.601286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:52.607315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:52.607830 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:52.608267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:52.608958 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:52.609412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:52.609835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:52.696121 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lazy-loading 'services' on Instance uuid c4453e93-3061-4fe5-a24d-a9c6c963aa90 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:23:52.769663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-396550cb-5fd1-4eed-9c65-9665c55d49da tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/25b44842-337c-4f94-b60b-9b1661d5ba9b" status: 202 len: 0 microversion: 2.1 time: 0.172619 Sep 10 14:23:52.770240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 564/1126] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:23:52 2022] DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments/25b44842-337c-4f94-b60b-9b1661d5ba9b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:23:53.240675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:53.241388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:53.243342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:53.248635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:53.249117 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:53.249552 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:53.250246 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:53.250701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:53.251857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:53.384479 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:53.392847 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cfed118f-0429-497f-9a44-6c7b0b515b9a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.157032 Sep 10 14:23:53.393881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 563/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:53 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:53.947389 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:53.949849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:53.956307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:53.956793 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:53.957265 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:53.957957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:53.958413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:53.958838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:53.987871 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-528ed307-f18a-4194-a1c0-33fc2c319224 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045171 Sep 10 14:23:53.988431 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 565/1128] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:23:53 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:23:54.104096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:54.106275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:54.113317 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.113792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.114227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.115166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.115642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.116059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.144707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f67c458e-6e34-4264-96fa-75c3f2226126 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045050 Sep 10 14:23:54.145251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 564/1129] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:23:54 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:23:54.207735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:54.208228 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:54.214073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.214557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.215002 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.215718 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.216173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.216597 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.241833 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:23:54.274257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:54.321149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6a9282ca-f513-4917-a588-e68ce054cd23 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 204 len: 0 microversion: 2.1 time: 0.117068 Sep 10 14:23:54.321790 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 566/1130] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:23:54 2022] DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:23:54.330016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:54.330635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:54.336572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.337056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.337491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.338192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.338646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.339076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.417390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:54.418221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:54.424907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.425479 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.425976 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.426847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:54.427474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:54.428073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:54.473182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:54.480854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f853164b-6acb-4752-acce-ce4ac8b9b2e9 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1673 microversion: 2.1 time: 0.154706 Sep 10 14:23:54.481611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 565/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:54 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:54.563413 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:54.571268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a68620a5-bd25-4bfc-abf4-bc57f041044f tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.158037 Sep 10 14:23:54.571822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 567/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:54 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:55.505192 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:55.505802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:55.507665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:55.508346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:55.515564 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:55.516044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:55.516477 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:55.517983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:55.518440 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:55.518862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:55.594192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:55.594795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:55.597414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:23:55.602610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:55.603110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:55.603575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:55.604275 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:55.604735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:55.605162 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:55.654680 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:55.662647 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0972dbee-eb78-4136-a17c-67a36c17b738 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1673 microversion: 2.1 time: 0.161645 Sep 10 14:23:55.663209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 566/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:55 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:55.740605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:55.748273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4a4f3c8e-e77c-4814-86cd-058ee5b06dbb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.157994 Sep 10 14:23:55.748832 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 568/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:55 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:56.686182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:56.686829 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:56.693953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:56.694379 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:56.694816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:56.695531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:56.695987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:56.696408 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:56.772335 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:56.772947 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:56.779605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:56.780097 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:56.780535 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:56.781235 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:56.781695 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:56.782120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:56.827639 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:56.835899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f0e2c699-fb7d-4959-b922-b57ff2088791 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1673 microversion: 2.1 time: 0.153555 Sep 10 14:23:56.836474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 567/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:56 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:56.912841 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:56.920628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6e6b317d-2c1e-4aea-91d4-cd58519d7f99 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.152188 Sep 10 14:23:56.921190 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 569/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:56 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:57.861061 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:57.861862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:57.868473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:57.868983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:57.869425 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:57.870112 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:57.870559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:57.870980 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:57.942356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:57.942961 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:57.949236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:57.949720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:57.950150 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:57.950839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:57.951285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:57.951737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:58.086348 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:58.094472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-43b4aeeb-8776-415e-b427-b02c7271d249 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.155923 Sep 10 14:23:58.106008 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 570/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:57 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:23:58.106793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:58.106793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-259ebdcd-44ac-4428-a00b-daf6b513e76c tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1673 microversion: 2.1 time: 0.248698 Sep 10 14:23:58.106793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 568/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:57 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:58.686661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-d345b0ce-0afc-4250-9704-ff8080e36683 req-071e98ac-6888-4ea7-8cad-f3a4086e6631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4453e93-3061-4fe5-a24d-a9c6c963aa90", "name": "network-vif-deleted", "tag": "f194f0b8-fc5a-434c-8501-9524a54a8e34"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:23:58.697795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-d345b0ce-0afc-4250-9704-ff8080e36683 req-071e98ac-6888-4ea7-8cad-f3a4086e6631 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:58.698275 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-d345b0ce-0afc-4250-9704-ff8080e36683 req-071e98ac-6888-4ea7-8cad-f3a4086e6631 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:58.698701 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-d345b0ce-0afc-4250-9704-ff8080e36683 req-071e98ac-6888-4ea7-8cad-f3a4086e6631 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:58.713655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-d345b0ce-0afc-4250-9704-ff8080e36683 req-071e98ac-6888-4ea7-8cad-f3a4086e6631 service nova] Creating event network-vif-deleted:f194f0b8-fc5a-434c-8501-9524a54a8e34 for instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 on hv-cinder-85690 Sep 10 14:23:58.718521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-d345b0ce-0afc-4250-9704-ff8080e36683 req-071e98ac-6888-4ea7-8cad-f3a4086e6631 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035533 Sep 10 14:23:58.719322 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 571/1139] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:23:59.121252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:59.123435 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:59.129208 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:23:59.129909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:23:59.130038 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:59.130489 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:59.130932 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:59.131665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:59.132121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:59.132540 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:59.137007 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:59.137423 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:59.137883 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:59.138572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:59.139022 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:59.139465 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:59.173236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:23:59.173236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:23:59.173542 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:23:59.173755 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lazy-loading 'fault' on Instance uuid c4453e93-3061-4fe5-a24d-a9c6c963aa90 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:23:59.222263 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea8ba61dfa54cbc9a45543d20f31e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efda1ce3d4d4dbbb5e8d5005902924d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:59.230234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ab40d00b-82c5-4032-b90d-7c66618f6764 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 200 len: 1326 microversion: 2.1 time: 0.105649 Sep 10 14:23:59.231326 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 572/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:59 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:23:59.272395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:23:59.280084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bd99f3a7-f7fe-47c8-971b-6686a97b204d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.163163 Sep 10 14:23:59.280650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 569/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:23:59 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:00.254333 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:00.254949 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:00.261506 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:00.262003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:00.262443 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:00.263142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:00.263685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:00.264113 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:00.278240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] HTTP exception thrown: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Request method failure captured: Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 HTTP/1.1 Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJubRWGlkrvtD7Ta-J58bVaOrm-ZZ8G5d_nJMmyQBdhYoXC2X-eHrUkPcExLsrtymiJsu2fa_mHEYJIq-WysL5W76ortlPWvbtcVUDHTUSnzQyKf97KF1fm2IutmhZjqkw4QrfXMYmkQqB_ngca1jEg3l4O5qediTWpzKB0Vtbd-8g0 Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:00.279955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6efda1ce3d4d4dbbb5e8d5005902924d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}] Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 8ea8ba61dfa54cbc9a45543d20f31e76 Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:00.281651 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': 'c4453e93-3061-4fe5-a24d-a9c6c963aa90'} Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:00.282512 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:00.283863 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:00.285061 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Returning 404 to user: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:00.285061 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-28160301-1f01-41e4-be6b-157db074c4a3 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 404 len: 111 microversion: 2.1 time: 0.031588 Sep 10 14:24:00.285061 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 573/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:00 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:00.290551 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b9d2b0e8-4bb6-43b3-9b35-14a9a122db32 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '.version_select at 0x7ff6b71b91f0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:00.302034 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:00.302826 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:00.309630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:00.310237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:00.310862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:00.311529 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:00.311821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b9d2b0e8-4bb6-43b3-9b35-14a9a122db32 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749036354" status: 202 len: 0 microversion: 2.1 time: 0.025061 Sep 10 14:24:00.312124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:00.312742 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:00.312931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 570/1143] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 10 14:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749036354 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:24:00.514558 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:00.522757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-36c59b41-b89f-476c-be37-28216397fc19 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.224632 Sep 10 14:24:00.530109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 574/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:00 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:24:01.546203 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:01.546826 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:01.554006 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:01.554462 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:01.554902 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:01.555673 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:01.556113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:01.556542 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:01.689953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:01.697529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-63ff9a49-c903-468a-9fe4-2ee2304e0a6b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.155300 Sep 10 14:24:01.698096 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 571/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:01 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:02.436913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-d9e922b6-a065-42e1-9e8e-f87becc8bc4b req-17cbfed1-b413-4861-8e34-79273d341aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "name": "network-vif-plugged", "status": "completed", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:24:02.448181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-d9e922b6-a065-42e1-9e8e-f87becc8bc4b req-17cbfed1-b413-4861-8e34-79273d341aa9 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:02.448666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-d9e922b6-a065-42e1-9e8e-f87becc8bc4b req-17cbfed1-b413-4861-8e34-79273d341aa9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:02.449096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-d9e922b6-a065-42e1-9e8e-f87becc8bc4b req-17cbfed1-b413-4861-8e34-79273d341aa9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:02.462225 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-d9e922b6-a065-42e1-9e8e-f87becc8bc4b req-17cbfed1-b413-4861-8e34-79273d341aa9 service nova] Creating event network-vif-plugged:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:24:02.467033 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-d9e922b6-a065-42e1-9e8e-f87becc8bc4b req-17cbfed1-b413-4861-8e34-79273d341aa9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Sep 10 14:24:02.467652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 575/1146] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:02.720871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:02.721492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:02.728010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:02.728500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:02.728941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:02.729638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:02.730095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:02.730522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:02.866228 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:02.874251 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-84789e0e-89a3-40c4-bb5a-92acd3e56a1a tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.157911 Sep 10 14:24:02.874831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 572/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:02 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:03.284124 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:03.284717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:03.290860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:03.291347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:03.291812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:03.292497 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:03.292955 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:03.293380 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:03.306347 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] HTTP exception thrown: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Request method failure captured: Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 HTTP/1.1 Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJubRWGlkrvtD7Ta-J58bVaOrm-ZZ8G5d_nJMmyQBdhYoXC2X-eHrUkPcExLsrtymiJsu2fa_mHEYJIq-WysL5W76ortlPWvbtcVUDHTUSnzQyKf97KF1fm2IutmhZjqkw4QrfXMYmkQqB_ngca1jEg3l4O5qediTWpzKB0Vtbd-8g0 Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:03.307993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6efda1ce3d4d4dbbb5e8d5005902924d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}] Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 8ea8ba61dfa54cbc9a45543d20f31e76 Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.309522 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': 'c4453e93-3061-4fe5-a24d-a9c6c963aa90'} Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:03.310365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.311852 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.314136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Returning 404 to user: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:03.314136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7c9274ec-a34c-48fc-9221-9b47d1d73683 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 404 len: 111 microversion: 2.1 time: 0.029786 Sep 10 14:24:03.314136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 576/1148] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:03 2022] DELETE /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:03.318633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:03.319244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: c4453e93-3061-4fe5-a24d-a9c6c963aa90] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:03.325115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:03.325587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:03.326018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:03.326696 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:03.327147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:03.327591 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:03.341424 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] HTTP exception thrown: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Request method failure captured: Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 HTTP/1.1 Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJubRWGlkrvtD7Ta-J58bVaOrm-ZZ8G5d_nJMmyQBdhYoXC2X-eHrUkPcExLsrtymiJsu2fa_mHEYJIq-WysL5W76ortlPWvbtcVUDHTUSnzQyKf97KF1fm2IutmhZjqkw4QrfXMYmkQqB_ngca1jEg3l4O5qediTWpzKB0Vtbd-8g0 Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:03.343028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6efda1ce3d4d4dbbb5e8d5005902924d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}] Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8ea8ba61dfa54cbc9a45543d20f31e76 Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.344669 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'c4453e93-3061-4fe5-a24d-a9c6c963aa90'} Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:03.345850 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. Sep 10 14:24:03.347305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:03.348638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Returning 404 to user: Instance c4453e93-3061-4fe5-a24d-a9c6c963aa90 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:03.348638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6e4e87ff-7b21-46f0-8d25-2c9832eccd63 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90" status: 404 len: 111 microversion: 2.1 time: 0.029951 Sep 10 14:24:03.348638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 573/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:03 2022] GET /compute/v2.1/servers/c4453e93-3061-4fe5-a24d-a9c6c963aa90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:03.897719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:03.898330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:03.904644 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:03.905118 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:03.905546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:03.906221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:03.906664 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:03.907108 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:04.044775 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:04.052496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7250aa6a-85d9-465b-86ae-5b90a99ebbb2 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1261 microversion: 2.1 time: 0.158661 Sep 10 14:24:04.053050 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 577/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:03 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:04.497451 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:04.497944 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:04.505040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:04.505523 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:04.505962 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:04.506646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:04.507099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:04.507550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:04.520678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] HTTP exception thrown: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Request method failure captured: Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 HTTP/1.1 Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJubRWGlkrvtD7Ta-J58bVaOrm-ZZ8G5d_nJMmyQBdhYoXC2X-eHrUkPcExLsrtymiJsu2fa_mHEYJIq-WysL5W76ortlPWvbtcVUDHTUSnzQyKf97KF1fm2IutmhZjqkw4QrfXMYmkQqB_ngca1jEg3l4O5qediTWpzKB0Vtbd-8g0 Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:04.522205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6efda1ce3d4d4dbbb5e8d5005902924d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}] Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8ea8ba61dfa54cbc9a45543d20f31e76 Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.523638 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '4d02053b-770b-4632-bbb2-f8867cb62341'} Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:04.524383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.525939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.527386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Returning 404 to user: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:04.527386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4fa01ea9-9e98-4ae6-8dfb-d943269604b1 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 404 len: 111 microversion: 2.1 time: 0.030560 Sep 10 14:24:04.527386 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 574/1151] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:04 2022] DELETE /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:04.532694 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:04.533299 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] [instance: 4d02053b-770b-4632-bbb2-f8867cb62341] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:04.535282 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:24:04.541199 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:04.541684 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:04.542156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:04.542844 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:04.543298 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:04.543793 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:04.557909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] HTTP exception thrown: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Request method failure captured: Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 HTTP/1.1 Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJubRWGlkrvtD7Ta-J58bVaOrm-ZZ8G5d_nJMmyQBdhYoXC2X-eHrUkPcExLsrtymiJsu2fa_mHEYJIq-WysL5W76ortlPWvbtcVUDHTUSnzQyKf97KF1fm2IutmhZjqkw4QrfXMYmkQqB_ngca1jEg3l4O5qediTWpzKB0Vtbd-8g0 Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:04.559432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6efda1ce3d4d4dbbb5e8d5005902924d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6efda1ce3d4d4dbbb5e8d5005902924d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6efda1ce3d4d4dbbb5e8d5005902924d"}]}] Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 6efda1ce3d4d4dbbb5e8d5005902924d Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1333438355 Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 8ea8ba61dfa54cbc9a45543d20f31e76 Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeTestJSON-1333438355-project Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.561043 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '4d02053b-770b-4632-bbb2-f8867cb62341'} Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:04.562023 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. Sep 10 14:24:04.563314 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:04.564918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] Returning 404 to user: Instance 4d02053b-770b-4632-bbb2-f8867cb62341 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:04.564918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6d9cf3e2-1e97-4e0d-b446-29be9711cc07 tempest-AttachVolumeTestJSON-1333438355 tempest-AttachVolumeTestJSON-1333438355-project] 10.222.0.26 "GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341" status: 404 len: 111 microversion: 2.1 time: 0.032544 Sep 10 14:24:04.564918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 578/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:04 2022] GET /compute/v2.1/servers/4d02053b-770b-4632-bbb2-f8867cb62341 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:05.075905 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:05.076716 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:05.083365 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:05.083887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:05.084327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:05.085029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:05.085473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:05.085892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:05.222254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:05.230063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-11e4be97-443c-455c-9b95-22c417df70f9 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1445 microversion: 2.1 time: 0.158111 Sep 10 14:24:05.230626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 575/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:05 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:05.252642 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:05.253257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:05.259652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:05.260144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:05.260584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:05.261278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:05.261734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:05.262157 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:05.473088 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:05.481588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3b5cbbd6-7401-4996-b74a-73ebba2d2615 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1445 microversion: 2.1 time: 0.232913 Sep 10 14:24:05.482472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 579/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:05 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1445 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:08.075353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-e2204bda-9d2b-4c9b-999a-13d748e1292e req-6c843b2e-4274-4d2a-afc9-b30486b88828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:24:08.089761 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-e2204bda-9d2b-4c9b-999a-13d748e1292e req-6c843b2e-4274-4d2a-afc9-b30486b88828 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:08.090572 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-e2204bda-9d2b-4c9b-999a-13d748e1292e req-6c843b2e-4274-4d2a-afc9-b30486b88828 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:08.091276 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-e2204bda-9d2b-4c9b-999a-13d748e1292e req-6c843b2e-4274-4d2a-afc9-b30486b88828 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:08.105816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-e2204bda-9d2b-4c9b-999a-13d748e1292e req-6c843b2e-4274-4d2a-afc9-b30486b88828 service nova] Creating event network-changed:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:24:08.111871 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-e2204bda-9d2b-4c9b-999a-13d748e1292e req-6c843b2e-4274-4d2a-afc9-b30486b88828 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040810 Sep 10 14:24:08.117051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 576/1155] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:24:10.054444 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d963ae9a-d7bc-4232-bf30-e33c4f32fd8f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Action: 'create', calling method: .version_select at 0x7ff6b733ddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1747321169", "metadata": {"Type": "work"}}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:24:10.339309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d963ae9a-d7bc-4232-bf30-e33c4f32fd8f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.396438 Sep 10 14:24:10.340000 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 580/1156] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 10 14:24:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 14:24:10.354207 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f073bbd9-fb8e-4364-8d6b-c0ca3282ce97 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Calling method '.version_select at 0x7ff6b7130940>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:10.405476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f073bbd9-fb8e-4364-8d6b-c0ca3282ce97 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2" status: 200 len: 353 microversion: 2.1 time: 0.055827 Sep 10 14:24:10.406263 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 577/1157] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:10 2022] GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:11.420925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9b82c5c6-a7d0-4925-ac02-593287c6df10 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Calling method '.version_select at 0x7ff6b7193820>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:11.468533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9b82c5c6-a7d0-4925-ac02-593287c6df10 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2" status: 200 len: 354 microversion: 2.1 time: 0.051886 Sep 10 14:24:11.469107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 581/1158] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:11 2022] GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:11.482288 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6b06f2c9-9acf-47e5-85ab-9cacd6039961 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Calling method '.version_select at 0x7ff6b7264ca0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:11.528527 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6b06f2c9-9acf-47e5-85ab-9cacd6039961 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2" status: 200 len: 354 microversion: 2.1 time: 0.050393 Sep 10 14:24:11.529113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 578/1159] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:11 2022] GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:11.547065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8b09f279-6f09-478c-a4c4-2bbefdb9cc2a tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Calling method '.version_select at 0x7ff6baa2daf0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:11.606115 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8b09f279-6f09-478c-a4c4-2bbefdb9cc2a tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2" status: 202 len: 0 microversion: 2.1 time: 0.062777 Sep 10 14:24:11.606671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 582/1160] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:24:11 2022] DELETE /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:24:11.615653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-f5adc7fc-ec6f-4b03-93f7-12c1677ee7f6 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Calling method '.version_select at 0x7ff6b6f859d0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:11.667411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-f5adc7fc-ec6f-4b03-93f7-12c1677ee7f6 tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2" status: 200 len: 353 microversion: 2.1 time: 0.056298 Sep 10 14:24:11.668012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 579/1161] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:11 2022] GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:12.682963 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:12.683513 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0aef6a9c-58a6-4ec6-be3c-00b3717b937f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Calling method '.version_select at 0x7ff6b706a280>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:12.684258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:12.693093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:12.693655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:12.694106 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:12.694807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:12.695262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:12.695717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:12.712045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-0aef6a9c-58a6-4ec6-be3c-00b3717b937f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] HTTP exception thrown: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0aef6a9c-58a6-4ec6-be3c-00b3717b937f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Request method failure captured: Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 HTTP/1.1 Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ4JYcrPGUq1QQYLzuRhUVBy-cddLqZfmedVNSWND6re1eYMUQqO8QQZkV68W-9E6K9GFlcgfUybb0dQxztyWI8ir6A8FYBKBveqvz5q6FTo6C5HMXBBu9OQgZTXgf7ERzlhZMPksA5_pkJqU1PJjuMAfAMVgdEjlRxy66MKS4dwLoU Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: c00eacefc2f4439699776b3cf4a439a6 Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-VolumesGetTestJSON-1242920063 Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:12.714108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c00eacefc2f4439699776b3cf4a439a6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c00eacefc2f4439699776b3cf4a439a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c00eacefc2f4439699776b3cf4a439a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c00eacefc2f4439699776b3cf4a439a6"}]}] Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-VolumesGetTestJSON-1242920063 Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: c00eacefc2f4439699776b3cf4a439a6 Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-VolumesGetTestJSON-1242920063 Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-VolumesGetTestJSON-1242920063-project Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 8c1499a50b984de4a0293767f8327b2c Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-VolumesGetTestJSON-1242920063-project Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '596d8fca-829b-464c-b6a6-d3a5341274c2'} Sep 10 14:24:12.715782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. (HTTP 404) (Request-ID: req-43951797-27e5-4fcd-bb0d-d953b81c4553) Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:12.716752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 14:24:12.718193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 14:24:12.719618 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0aef6a9c-58a6-4ec6-be3c-00b3717b937f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] Returning 404 to user: Volume 596d8fca-829b-464c-b6a6-d3a5341274c2 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0aef6a9c-58a6-4ec6-be3c-00b3717b937f tempest-VolumesGetTestJSON-1242920063 tempest-VolumesGetTestJSON-1242920063-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2" status: 404 len: 109 microversion: 2.1 time: 0.036882 Sep 10 14:24:12.721011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 580/1162] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:12 2022] GET /compute/v2.1/os-volumes/596d8fca-829b-464c-b6a6-d3a5341274c2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:12.722526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-abf2d81d-96f4-4581-9f27-f7892e8af9fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/ips" status: 200 len: 149 microversion: 2.1 time: 0.040433 Sep 10 14:24:12.722526 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 583/1163] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 10 14:24:12 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:14.097325 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64243ae0-3422-4c62-9b79-2e52d65ec6bf"}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:24:14.100462 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:14.107011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:14.107727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:14.108116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:14.108832 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:14.109294 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:14.109723 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:14.112917 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:24:14.390950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-19e48098-a86e-44ba-b5a3-f26292f82dbe tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "POST /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298422 Sep 10 14:24:14.392600 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 581/1164] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 10 14:24:14 2022] POST /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:22.074993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:22.075543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:22.081824 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:22.082310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:22.083541 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:22.084255 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:22.084723 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:22.085154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:22.170946 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.objects.instance [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lazy-loading 'services' on Instance uuid be25ecec-8682-4136-9f67-f906075122b4 {{(pid=120617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:24:22.246763 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-29361462-3a28-488f-91c3-d48475331bf7 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments/64243ae0-3422-4c62-9b79-2e52d65ec6bf" status: 202 len: 0 microversion: 2.1 time: 0.175479 Sep 10 14:24:22.247381 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 584/1165] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 10 14:24:22 2022] DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments/64243ae0-3422-4c62-9b79-2e52d65ec6bf => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:24:22.257575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:22.259821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:22.266078 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:22.266579 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:22.267032 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:22.267856 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:22.268316 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:22.268759 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:22.299395 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-83ffdf83-a0fe-4d67-a5b7-e81241e56166 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047379 Sep 10 14:24:22.300034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 582/1166] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:24:22 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:24:23.314088 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:23.316437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:23.323163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:23.323757 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:23.324364 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:23.325209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:23.325879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:23.326416 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:23.358990 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e7529e67-4f68-4e1b-98fd-40a961323f4b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050910 Sep 10 14:24:23.359795 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 585/1167] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 10 14:24:23 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 14:24:23.425822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:23.426361 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:23.429109 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:24:23.434403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:23.434881 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:23.435352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:23.436041 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:23.436492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:23.436907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:23.464900 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:24:23.546971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e21ed531-00a2-4bdd-a330-852878560815 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 204 len: 0 microversion: 2.1 time: 0.124768 Sep 10 14:24:23.548048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 583/1168] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:23 2022] DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:24:23.557851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:23.558746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:23.564906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:23.565601 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:23.566040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:23.567250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:23.567730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:23.568156 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:23.709768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:23.720203 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4526274b-81dc-465c-aa14-c01a94294517 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1680 microversion: 2.1 time: 0.166178 Sep 10 14:24:23.720774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 586/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:23 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:24:24.744892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:24.745651 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:24.752065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:24.752547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:24.752982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:24.753844 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:24.754916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:24.755849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:24.889143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:24.898872 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cf0b368b-952e-4b11-9360-bbfd1234ab46 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1680 microversion: 2.1 time: 0.158849 Sep 10 14:24:24.899468 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 584/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:24 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:25.922639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:25.923248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:25.929993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:25.930470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:25.930900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:25.931626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:25.932076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:25.932496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:25.935137 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:24:26.065564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:26.074032 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4bd1b9e1-3cce-49ba-bce6-989801748bdf tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1680 microversion: 2.1 time: 0.155588 Sep 10 14:24:26.074596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 587/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:25 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:27.012286 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-d80e6e9c-3e60-4500-86cb-2b45a2c49f89 req-0cda182d-3483-4c27-ba63-cc85293a4ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be25ecec-8682-4136-9f67-f906075122b4", "name": "network-vif-deleted", "tag": "579fa464-e6ee-492c-bff1-065ee60ed4c5"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:24:27.023628 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d80e6e9c-3e60-4500-86cb-2b45a2c49f89 req-0cda182d-3483-4c27-ba63-cc85293a4ba5 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:27.024111 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d80e6e9c-3e60-4500-86cb-2b45a2c49f89 req-0cda182d-3483-4c27-ba63-cc85293a4ba5 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:27.024538 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d80e6e9c-3e60-4500-86cb-2b45a2c49f89 req-0cda182d-3483-4c27-ba63-cc85293a4ba5 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:27.039298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-d80e6e9c-3e60-4500-86cb-2b45a2c49f89 req-0cda182d-3483-4c27-ba63-cc85293a4ba5 service nova] Creating event network-vif-deleted:579fa464-e6ee-492c-bff1-065ee60ed4c5 for instance be25ecec-8682-4136-9f67-f906075122b4 on hv-cinder-85690 Sep 10 14:24:27.045001 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-d80e6e9c-3e60-4500-86cb-2b45a2c49f89 req-0cda182d-3483-4c27-ba63-cc85293a4ba5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036289 Sep 10 14:24:27.045597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 585/1172] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:27.098215 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:27.100014 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:27.107539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:27.108310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:27.108972 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:27.110075 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:27.110956 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:27.111649 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:27.198320 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2f1171c5394a1c8879cd09c1e685b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f11e95e757488fa7c4c156194d24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:27.210788 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fd1ac4c4-a9b7-4162-baf1-9336aaed6db9 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 200 len: 1325 microversion: 2.1 time: 0.116937 Sep 10 14:24:27.212131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 588/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:27 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 1325 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:24:28.234924 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:28.235745 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:28.243623 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:28.244087 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:28.244504 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:28.245193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:28.245642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:28.246064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:28.259090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 HTTP/1.1 Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:28.260756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:28.262404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'be25ecec-8682-4136-9f67-f906075122b4'} Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:28.263254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:28.264578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:28.265769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:28.265769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3d52d0a9-b92b-43fe-b0d0-1ceec723e9c1 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 404 len: 111 microversion: 2.1 time: 0.031557 Sep 10 14:24:28.265769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 586/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:28 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:28.271620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-87d9ce90-f727-434c-b8a7-7523497607e5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '.version_select at 0x7ff6b7496e50>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:28.294379 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-87d9ce90-f727-434c-b8a7-7523497607e5 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-915489864" status: 202 len: 0 microversion: 2.1 time: 0.026943 Sep 10 14:24:28.298430 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 589/1175] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 10 14:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-915489864 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:24:30.097388 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:30.098769 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:30.105863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:30.106420 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:30.106927 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:30.107730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:30.108259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:30.108752 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:30.123775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 HTTP/1.1 Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:30.125360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.126770 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'be25ecec-8682-4136-9f67-f906075122b4'} Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:30.127708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.129470 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.131343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:30.131343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-0a9f7fb8-5c61-4464-b819-5137791d71c4 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 404 len: 111 microversion: 2.1 time: 0.033371 Sep 10 14:24:30.131343 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 587/1176] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:30 2022] DELETE /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:30.136249 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:30.136856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: be25ecec-8682-4136-9f67-f906075122b4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:30.143197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:30.143700 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:30.144136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:30.144874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:30.145323 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:30.145740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:30.158613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 HTTP/1.1 Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:30.160840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.162691 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': 'be25ecec-8682-4136-9f67-f906075122b4'} Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:30.163484 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. Sep 10 14:24:30.164774 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:30.166747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance be25ecec-8682-4136-9f67-f906075122b4 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:30.166747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c503aeb5-5f79-44d7-b7fb-4ffb12b4c98a tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4" status: 404 len: 111 microversion: 2.1 time: 0.030459 Sep 10 14:24:30.166747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 590/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:30 2022] GET /compute/v2.1/servers/be25ecec-8682-4136-9f67-f906075122b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:31.309353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:31.309878 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:31.316243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.316768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.317206 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.317888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.318338 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.318756 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.331848 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f HTTP/1.1 Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:31.334043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.335637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '028facf8-adb9-4054-9c61-5420c17ce80f'} Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:31.336466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.337714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.339179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:31.339179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-438334d9-8068-4bed-a8c3-a01325a910fc tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 404 len: 111 microversion: 2.1 time: 0.030310 Sep 10 14:24:31.339179 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 588/1178] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:31 2022] DELETE /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:31.344357 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:31.344964 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 028facf8-adb9-4054-9c61-5420c17ce80f] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:31.351983 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.352457 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.352885 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.353559 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.354004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.354419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.371829 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f HTTP/1.1 Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:31.373318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.374907 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '028facf8-adb9-4054-9c61-5420c17ce80f'} Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:31.375806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. Sep 10 14:24:31.377387 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.378985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 028facf8-adb9-4054-9c61-5420c17ce80f could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:31.378985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-85e3284d-0ddd-4f1a-bd39-fd6aa6cbdd80 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f" status: 404 len: 111 microversion: 2.1 time: 0.034114 Sep 10 14:24:31.378985 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 591/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:31 2022] GET /compute/v2.1/servers/028facf8-adb9-4054-9c61-5420c17ce80f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:31.383047 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:31.383566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:31.389478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.389955 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.390390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.391070 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.391547 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.391969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.405604 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 HTTP/1.1 Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:31.407121 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.408732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '64b950a5-ef31-4b7e-997f-eaac009116e4'} Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:31.409695 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.411999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.413476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:31.413476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-018b2e85-1484-4155-a635-628db9eac88b tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 404 len: 111 microversion: 2.1 time: 0.029397 Sep 10 14:24:31.413476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 589/1180] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:31 2022] DELETE /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:31.417250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:31.417859 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 64b950a5-ef31-4b7e-997f-eaac009116e4] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:31.423787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.424268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.424730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.425389 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:31.425913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:31.426337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:31.440013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 HTTP/1.1 Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:31.441740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.443352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '64b950a5-ef31-4b7e-997f-eaac009116e4'} Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:31.444288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. Sep 10 14:24:31.445783 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:31.447400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 64b950a5-ef31-4b7e-997f-eaac009116e4 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:31.447400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-277e8bff-552b-420b-970d-ae00336eb9db tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4" status: 404 len: 111 microversion: 2.1 time: 0.029550 Sep 10 14:24:31.447400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 592/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:31 2022] GET /compute/v2.1/servers/64b950a5-ef31-4b7e-997f-eaac009116e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 14:24:32.584743 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:32.585407 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:32.593205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:32.593689 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:32.594329 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:32.595022 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:32.595491 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:32.595937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:32.611502 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 HTTP/1.1 Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:32.613969 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.615939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149'} Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:32.619936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.621505 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.622997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:32.622997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3477f071-b8de-414a-bbec-0535595e0c07 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 404 len: 111 microversion: 2.1 time: 0.036452 Sep 10 14:24:32.622997 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 590/1182] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:24:32 2022] DELETE /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:32.624610 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:32.625217 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] [instance: 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:32.632617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:32.633083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:32.633728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:32.634441 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:32.634895 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:32.635332 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:32.649193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] HTTP exception thrown: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Request method failure captured: Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 HTTP/1.1 Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuS-MVwkM19_viZVQzGi897L2tZ5tcJnbUN9FjRiB9zDlHOg9Gy_XY4icp3pt-EtQUH43l6oO9Jn13Y6d7r0QuR95JgncvCJq6d_hIZh1uW4jCiyySTo5aWTmYaOXR7ER4wbbQE49EnLFA1bfaz4Zz1A7dd_yCFTguXLrCEkfIkK-M Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:32.650719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68f11e95e757488fa7c4c156194d24ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68f11e95e757488fa7c4c156194d24ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68f11e95e757488fa7c4c156194d24ff"}]}] Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 68f11e95e757488fa7c4c156194d24ff Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475195651 Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: db2f1171c5394a1c8879cd09c1e685b1 Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeNegativeTest-1475195651-project Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.652344 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149'} Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:32.653280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. Sep 10 14:24:32.654767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:32.656240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] Returning 404 to user: Instance 3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:32.656240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3348c6ab-e3bc-40f7-b7b1-f4f19e642154 tempest-AttachVolumeNegativeTest-1475195651 tempest-AttachVolumeNegativeTest-1475195651-project] 10.222.0.26 "GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149" status: 404 len: 111 microversion: 2.1 time: 0.031363 Sep 10 14:24:32.656240 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 593/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:24:32 2022] GET /compute/v2.1/servers/3c279d0b-fc2a-4592-b3c9-d2dcf5b8e149 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:24:37.744543 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:37.746705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:37.752867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:37.754664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:37.755266 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:37.756018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:37.756467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:37.757062 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:37.789398 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b3d8e7d2-bc59-46b8-ae24-e9fbb7d05a24 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048484 Sep 10 14:24:37.790040 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 591/1184] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 10 14:24:37 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:24:37.856682 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:37.857613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:37.861410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:24:37.868052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:37.868904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:37.869415 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:37.870194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:37.870909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:37.871777 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:37.902205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:24:37.993331 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-663cc27f-103c-472e-8949-ffcbd24dd4ff tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 204 len: 0 microversion: 2.20 time: 0.139822 Sep 10 14:24:37.994307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 594/1185] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 10 14:24:37 2022] DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 14:24:38.002637 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:38.003260 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:38.009498 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:38.010043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:38.010522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:38.011227 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:38.011708 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:38.012318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:38.167725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:38.177788 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:38.179275 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:38.180569 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4b332de0-bd6e-473d-bc8c-33d3fa13190d tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.181920 Sep 10 14:24:38.181534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 592/1186] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:37 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:24:39.209461 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:39.210439 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:39.220977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:39.221469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:39.221905 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:39.223324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:39.224107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:39.224536 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:39.395327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:39.405746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:39.405746 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:39.406827 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cc2f412d-9050-460c-898f-17b358444420 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.202899 Sep 10 14:24:39.407358 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 595/1187] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:39 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:24:40.439323 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:40.441414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:40.447800 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:40.448285 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:40.448941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:40.449691 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:40.450089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:40.450681 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:40.690164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:40.701303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:40.703166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:40.704759 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-36befcfd-a17a-4d7d-8423-f8cba7534f14 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1725 microversion: 2.20 time: 0.274530 Sep 10 14:24:40.705668 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 593/1188] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:40 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 14:24:41.000502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-ebe3de5c-2c53-46b9-a4de-0730cd2aed45 req-0167232b-b554-4d56-a79b-aa4250045455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f518a0-dce2-48aa-ac83-7fe61cd4118e", "name": "network-vif-deleted", "tag": "06d24fbe-cfb2-4175-b54d-2198dd51883e"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:24:41.019492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ebe3de5c-2c53-46b9-a4de-0730cd2aed45 req-0167232b-b554-4d56-a79b-aa4250045455 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:41.019989 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ebe3de5c-2c53-46b9-a4de-0730cd2aed45 req-0167232b-b554-4d56-a79b-aa4250045455 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:41.020424 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-ebe3de5c-2c53-46b9-a4de-0730cd2aed45 req-0167232b-b554-4d56-a79b-aa4250045455 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:41.032838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-ebe3de5c-2c53-46b9-a4de-0730cd2aed45 req-0167232b-b554-4d56-a79b-aa4250045455 service nova] Creating event network-vif-deleted:06d24fbe-cfb2-4175-b54d-2198dd51883e for instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e on hv-cinder-85690 Sep 10 14:24:41.045640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-ebe3de5c-2c53-46b9-a4de-0730cd2aed45 req-0167232b-b554-4d56-a79b-aa4250045455 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055181 Sep 10 14:24:41.046719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 596/1189] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:24:41.734414 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:41.735034 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:41.744194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:41.744682 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:41.745123 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:41.745831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:41.746281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:41.746730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:41.785506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:41.785999 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:41.786438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:41.786889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lazy-loading 'fault' on Instance uuid e8f518a0-dce2-48aa-ac83-7fe61cd4118e {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:24:41.837721 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:41.845776 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:41.848042 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '810f0fa1f7774b37a09a91964c40b823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5947e3bd184558bc1a8febcedce00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:24:41.849312 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e92ea0e0-b1d5-41c6-b364-5a82b0f630ef tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 200 len: 1371 microversion: 2.20 time: 0.118925 Sep 10 14:24:41.850074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 594/1190] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:41 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 14:24:42.877003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:42.877744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:42.884414 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:42.884899 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:42.885334 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:42.886016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:42.886472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:42.886911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:42.902016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] HTTP exception thrown: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Request method failure captured: Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e HTTP/1.1 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuehMqNV6UYXTdX_gqaVyAHpd-JUvm0WsqeFNgiOXwciLYhnpJVuEib2EZdJhOvTQVcd8tEjPJ-sxOqSUbNaUvU8EGEmSfOO1kZtCf6t81GoGuazVfZqcFv9Q5yYBuEVPw9Kv5FTdrieoghoD7Nw_ZzkXa672O904Hw81HNPpEQN64 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:42.903687 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d5947e3bd184558bc1a8febcedce00f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}] Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 810f0fa1f7774b37a09a91964c40b823 Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:42.905383 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': 'e8f518a0-dce2-48aa-ac83-7fe61cd4118e'} Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:42.906328 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:42.907870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:42.910079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Returning 404 to user: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:42.910079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7895a834-9f90-49c6-b7be-b70f06e5c839 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 404 len: 111 microversion: 2.20 time: 0.033036 Sep 10 14:24:42.910079 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 597/1191] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:42 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:24:42.914825 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-619f1ec4-ca0c-4e71-926f-1ff0f4e4b763 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '.version_select at 0x7ff6b7264790>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:42.935626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-619f1ec4-ca0c-4e71-926f-1ff0f4e4b763 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901340103" status: 204 len: 0 microversion: 2.20 time: 0.024729 Sep 10 14:24:42.936194 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 595/1192] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Sep 10 14:24:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901340103 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 14:24:44.729440 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:44.729973 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:44.736336 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:44.736812 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:44.737245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:44.738588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:44.739044 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:44.739744 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:44.752909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] HTTP exception thrown: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Request method failure captured: Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e HTTP/1.1 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuehMqNV6UYXTdX_gqaVyAHpd-JUvm0WsqeFNgiOXwciLYhnpJVuEib2EZdJhOvTQVcd8tEjPJ-sxOqSUbNaUvU8EGEmSfOO1kZtCf6t81GoGuazVfZqcFv9Q5yYBuEVPw9Kv5FTdrieoghoD7Nw_ZzkXa672O904Hw81HNPpEQN64 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:44.755209 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d5947e3bd184558bc1a8febcedce00f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}] Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 810f0fa1f7774b37a09a91964c40b823 Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.756906 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': 'e8f518a0-dce2-48aa-ac83-7fe61cd4118e'} Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:44.757834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.759579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.761110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Returning 404 to user: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:44.761110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cc7b9ea2-ae88-4b93-81da-73aaba7da562 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 404 len: 111 microversion: 2.20 time: 0.031186 Sep 10 14:24:44.761110 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 598/1193] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 10 14:24:44 2022] DELETE /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:24:44.765888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:44.766497 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: e8f518a0-dce2-48aa-ac83-7fe61cd4118e] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:44.775511 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:44.776005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:44.776448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:44.777146 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:44.777597 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:44.778018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:44.780892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:24:44.793464 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] HTTP exception thrown: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Request method failure captured: Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e HTTP/1.1 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuehMqNV6UYXTdX_gqaVyAHpd-JUvm0WsqeFNgiOXwciLYhnpJVuEib2EZdJhOvTQVcd8tEjPJ-sxOqSUbNaUvU8EGEmSfOO1kZtCf6t81GoGuazVfZqcFv9Q5yYBuEVPw9Kv5FTdrieoghoD7Nw_ZzkXa672O904Hw81HNPpEQN64 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:44.795018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d5947e3bd184558bc1a8febcedce00f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}] Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 810f0fa1f7774b37a09a91964c40b823 Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.796709 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'e8f518a0-dce2-48aa-ac83-7fe61cd4118e'} Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:44.797589 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. Sep 10 14:24:44.799065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:44.801476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Returning 404 to user: Instance e8f518a0-dce2-48aa-ac83-7fe61cd4118e could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:44.801476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3dc65b10-dfab-48e9-9988-67af130cb7ac tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e" status: 404 len: 111 microversion: 2.20 time: 0.034982 Sep 10 14:24:44.801476 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 596/1194] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:44 2022] GET /compute/v2.1/servers/e8f518a0-dce2-48aa-ac83-7fe61cd4118e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 14:24:50.169039 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:50.169554 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:50.175917 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:50.176889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:50.177438 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:50.178129 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:50.178579 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:50.178999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:50.195244 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] HTTP exception thrown: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Request method failure captured: Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 HTTP/1.1 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJuehMqNV6UYXTdX_gqaVyAHpd-JUvm0WsqeFNgiOXwciLYhnpJVuEib2EZdJhOvTQVcd8tEjPJ-sxOqSUbNaUvU8EGEmSfOO1kZtCf6t81GoGuazVfZqcFv9Q5yYBuEVPw9Kv5FTdrieoghoD7Nw_ZzkXa672O904Hw81HNPpEQN64 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:24:50.197218 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d5947e3bd184558bc1a8febcedce00f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}] Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: 810f0fa1f7774b37a09a91964c40b823 Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.199015 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '5c6e701d-06b7-4ca6-a202-2327ce74a974'} Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:50.199978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.201632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.204434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Returning 404 to user: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:50.204434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e60b7ca8-485e-481e-927b-355627ed7f19 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 404 len: 111 microversion: 2.20 time: 0.033477 Sep 10 14:24:50.204434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 599/1195] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 10 14:24:50 2022] DELETE /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:24:50.209084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:50.209712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] [instance: 5c6e701d-06b7-4ca6-a202-2327ce74a974] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:24:50.217960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:50.218548 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:50.219081 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:50.219817 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:24:50.220373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:24:50.220718 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] HTTP exception thrown: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Request method failure captured: Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 HTTP/1.1 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJuehMqNV6UYXTdX_gqaVyAHpd-JUvm0WsqeFNgiOXwciLYhnpJVuEib2EZdJhOvTQVcd8tEjPJ-sxOqSUbNaUvU8EGEmSfOO1kZtCf6t81GoGuazVfZqcFv9Q5yYBuEVPw9Kv5FTdrieoghoD7Nw_ZzkXa672O904Hw81HNPpEQN64 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:24:50.243298 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d5947e3bd184558bc1a8febcedce00f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d5947e3bd184558bc1a8febcedce00f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d5947e3bd184558bc1a8febcedce00f"}]}] Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: 7d5947e3bd184558bc1a8febcedce00f Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281345023 Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: 810f0fa1f7774b37a09a91964c40b823 Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281345023-project Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.249478 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '5c6e701d-06b7-4ca6-a202-2327ce74a974'} Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:24:50.250269 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. Sep 10 14:24:50.251520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:24:50.253060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] Returning 404 to user: Instance 5c6e701d-06b7-4ca6-a202-2327ce74a974 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:24:50.253060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d9494b99-4ce0-4934-8615-86689fc7abc7 tempest-AttachVolumeShelveTestJSON-1281345023 tempest-AttachVolumeShelveTestJSON-1281345023-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974" status: 404 len: 111 microversion: 2.20 time: 0.039206 Sep 10 14:24:50.253060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 597/1196] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 10 14:24:50 2022] GET /compute/v2.1/servers/5c6e701d-06b7-4ca6-a202-2327ce74a974 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 14:24:57.564533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4c8ff459-a990-4c55-a076-7b92157ce4d2 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b7301c10>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:57.613408 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4c8ff459-a990-4c55-a076-7b92157ce4d2 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/81989cb1-2dcd-4ecf-9780-2af043992dd2" status: 200 len: 350 microversion: 2.1 time: 0.052531 Sep 10 14:24:57.614483 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 600/1197] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:57 2022] GET /compute/v2.1/os-volumes/81989cb1-2dcd-4ecf-9780-2af043992dd2 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:24:58.988641 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e23c48ec-7ad0-4a3b-9070-438fb8a26d66 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b713cb80>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:24:59.037362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e23c48ec-7ad0-4a3b-9070-438fb8a26d66 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1da341d9-1460-4bce-b658-818b1e691773" status: 200 len: 350 microversion: 2.1 time: 0.052185 Sep 10 14:24:59.038059 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 598/1198] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:24:58 2022] GET /compute/v2.1/os-volumes/1da341d9-1460-4bce-b658-818b1e691773 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:25:01.424900 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:25:01.425761 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:25:01.430384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b6105dc5-f4f2-46fd-aca3-cc69b91de874 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b73569d0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:01.480785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b6105dc5-f4f2-46fd-aca3-cc69b91de874 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b97307c9-5e48-498e-9491-bbef1ff1e53e" status: 200 len: 349 microversion: 2.1 time: 0.057194 Sep 10 14:25:01.481376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 601/1199] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes/b97307c9-5e48-498e-9491-bbef1ff1e53e => generated 349 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:25:01.491998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:25:01.492740 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:25:01.496965 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-02c9621e-2812-4e4e-abcf-8d32df338bd6 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b727ae50>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:01.579127 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-02c9621e-2812-4e4e-abcf-8d32df338bd6 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.088190 Sep 10 14:25:01.579725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 599/1200] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:25:01.594149 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1a916c77-6c43-46cb-95be-2f0547b69545 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b74d3550>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:01.685109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1a916c77-6c43-46cb-95be-2f0547b69545 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.094590 Sep 10 14:25:01.685704 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 602/1201] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:25:01.700725 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-535de19f-c6cf-4c03-9ec9-6cc241195ee6 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b7264790>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:01.786068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-535de19f-c6cf-4c03-9ec9-6cc241195ee6 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.089046 Sep 10 14:25:01.786803 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 600/1202] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:25:01.799673 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4c3682b9-640b-441a-8772-e4460e7ec105 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b737ea60>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:01.884672 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4c3682b9-640b-441a-8772-e4460e7ec105 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088781 Sep 10 14:25:01.885279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 603/1203] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:25:01.899186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-097247f0-a14f-4736-b826-1ec83dd8c656 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b73eba60>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:01.982267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-097247f0-a14f-4736-b826-1ec83dd8c656 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.086776 Sep 10 14:25:01.982837 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 601/1204] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:25:01.998161 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-037ce224-ffed-49c4-9010-e8b407444359 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b7206ee0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:02.081035 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-037ce224-ffed-49c4-9010-e8b407444359 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.086622 Sep 10 14:25:02.081721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 604/1205] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 10 14:25:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:25:02.094908 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c239eb88-5c7c-4e4b-94ae-2cc5ee847cdf tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b71225e0>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:02.180412 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c239eb88-5c7c-4e4b-94ae-2cc5ee847cdf tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089185 Sep 10 14:25:02.181001 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 602/1206] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Sep 10 14:25:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:25:02.195060 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a94a177c-dac5-4181-ab3c-36fa8425e773 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] Calling method '.version_select at 0x7ff6b7356f70>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:25:02.277925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a94a177c-dac5-4181-ab3c-36fa8425e773 tempest-VolumesTestJSON-1824991430 tempest-VolumesTestJSON-1824991430-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.087030 Sep 10 14:25:02.278488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 605/1207] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 10 14:25:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:12.308105 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:26:12.308664 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Sat Sep 10 14:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 (ip 10.222.0.26) !!! Sep 10 14:26:12.313506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:12.313996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:12.321148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:12.321620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:12.322766 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:12.323655 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:12.324107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:12.324528 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:12.349396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:26:12.434319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-709fbc30-63ed-4cc9-8ba3-784821b901e9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 204 len: 0 microversion: 2.1 time: 0.128934 Sep 10 14:26:12.435104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 603/1208] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:26:12 2022] DELETE /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:26:12.441817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:26:12.442224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sat Sep 10 14:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 (ip 10.222.0.26) !!! Sep 10 14:26:12.452191 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:12.452800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:12.459636 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:12.460119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:12.460605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:12.461286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:12.461739 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:12.462196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:12.598688 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:12.607089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4071d190-5ea3-426a-9526-f62f25405744 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1579 microversion: 2.1 time: 0.167758 Sep 10 14:26:12.607674 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 606/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:12 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:26:13.633421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:13.634128 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:13.641014 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:13.641501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:13.641941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:13.642635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:13.643090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:13.643541 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:13.789862 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:13.798500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9e8f0bbb-30a1-4f32-a56e-e36f5fb47c48 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1579 microversion: 2.1 time: 0.169265 Sep 10 14:26:13.799119 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 604/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:13 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:14.822894 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:14.823800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:14.830831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:14.831839 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:14.832410 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:14.833471 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:14.834100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:14.834787 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:14.974363 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:14.982233 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-31ea112d-a0ef-481a-8afc-d621b25a9061 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1579 microversion: 2.1 time: 0.164100 Sep 10 14:26:14.982810 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 607/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:14 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:16.006549 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:16.007940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:16.017667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:16.018571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:16.022327 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:16.023478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:16.025260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:16.026232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:16.101925 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:16.110851 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f7444fb5-695d-4f6c-860e-b55f41aa33df tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1511 microversion: 2.1 time: 0.109279 Sep 10 14:26:16.123487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 608/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:16 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:26:16.168396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-7b17d05c-0104-441a-beee-3106143af1ba req-2a9185ce-6ee9-4307-a355-9028a1c39c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7469fb7b-1361-4524-9eba-6ef556a22815", "name": "network-vif-deleted", "tag": "71816fb4-ad1f-4ea4-be98-351d115e688c"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:26:16.178358 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-7b17d05c-0104-441a-beee-3106143af1ba req-2a9185ce-6ee9-4307-a355-9028a1c39c8f service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:16.179113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-7b17d05c-0104-441a-beee-3106143af1ba req-2a9185ce-6ee9-4307-a355-9028a1c39c8f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:16.179650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-7b17d05c-0104-441a-beee-3106143af1ba req-2a9185ce-6ee9-4307-a355-9028a1c39c8f service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:16.191889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-7b17d05c-0104-441a-beee-3106143af1ba req-2a9185ce-6ee9-4307-a355-9028a1c39c8f service nova] Creating event network-vif-deleted:71816fb4-ad1f-4ea4-be98-351d115e688c for instance 7469fb7b-1361-4524-9eba-6ef556a22815 on hv-cinder-85690 Sep 10 14:26:16.196907 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-7b17d05c-0104-441a-beee-3106143af1ba req-2a9185ce-6ee9-4307-a355-9028a1c39c8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272489 Sep 10 14:26:16.201453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 605/1213] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:26:17.136284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:17.136881 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:17.143283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:17.143806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:17.144246 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:17.144938 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:17.145444 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:17.145822 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:17.208730 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:17.216351 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bded84c3-dfa8-458e-9b9a-87c9df7890a9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1511 microversion: 2.1 time: 0.083925 Sep 10 14:26:17.216920 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 609/1214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:17 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:18.241073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:18.241687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:18.248663 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:18.249141 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:18.249571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:18.250250 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:18.250707 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:18.251139 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:18.315185 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:18.323822 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-674e40a7-82ec-4fba-8d72-b911c5563d75 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1511 microversion: 2.1 time: 0.087673 Sep 10 14:26:18.324384 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 606/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:18 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:19.346850 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:19.347397 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:19.353817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:19.354398 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:19.354834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:19.355533 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:19.355981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:19.356396 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:19.418941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:19.426733 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-07455b2c-c79d-4857-a59f-714c09c35ddd tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1511 microversion: 2.1 time: 0.084007 Sep 10 14:26:19.427294 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 610/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:19 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:20.454211 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:20.454831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:20.461271 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:20.461755 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:20.462727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:20.463413 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:20.463892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:20.464315 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:20.525319 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:20.532992 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-28ec66d2-afb0-4357-9722-36ebb35ec231 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1226 microversion: 2.1 time: 0.082741 Sep 10 14:26:20.533550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 607/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:20 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:21.556621 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:21.557231 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:21.564017 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:21.564657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:21.565089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:21.565769 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:21.566214 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:21.566630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:21.635778 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:21.643577 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-bb73bf6a-e307-42b0-b431-de1e1868b117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 200 len: 1226 microversion: 2.1 time: 0.091005 Sep 10 14:26:21.644148 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 611/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:21 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:22.666620 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:22.667232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:22.673936 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:22.674405 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:22.674863 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:22.675567 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:22.676015 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:22.676428 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:22.690432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] HTTP exception thrown: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Request method failure captured: Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 HTTP/1.1 Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ2sbT8Z1oxXBi728b2_lCVUiZkrhM6Xp87bQnwFQkFi5gFa-3Ax-yhDYNppRLWdv93-2lI8LR2vb76mPn_pRYcX9yOn6NkYp-N27Tl6xSxjRz8hRkapGMG9kOO4tFVXFaFYxu8l90AzONkM6tc90PhMRPOjCfz_icX3tZDubXH5wO0 Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:26:22.692140 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8d41b873ac94a33beb63a2d89a218ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}] Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: f4638a1936f5467db502bda82320b113 Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:26:22.694796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '7469fb7b-1361-4524-9eba-6ef556a22815'} Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:26:22.695855 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:26:22.698233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:26:22.700419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Returning 404 to user: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:26:22.700419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-6d1c5ebf-c8ec-436f-83e1-aa33743ee863 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 404 len: 111 microversion: 2.1 time: 0.030839 Sep 10 14:26:22.700419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 608/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:22 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:26:22.791532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-962352652", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1666901075", "security_groups": [{"name": "tempest-secgroup-smoke-1642103404"}], "block_device_mapping_v2": [{"uuid": "cb7fd7c6-d6fd-45a5-907c-0ad57d0ef5d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "50038936-7823-499b-a2d7-942d23b9f352"}]}} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:26:22.904348 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.network.neutron [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] validate_networks() for [('50038936-7823-499b-a2d7-942d23b9f352', None, None, None, None, None)] {{(pid=120617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:26:23.386630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Flavor limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:26:23.387057 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Image limits 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:26:23.387564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Flavor pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:26:23.387981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Image pref 0:0:0 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:26:23.388394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.virt.hardware [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:26:23.397346 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:23.397835 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:23.398286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:23.398996 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:23.400074 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:23.400538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:23.418548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:26:23.422575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.quota [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for user f4638a1936f5467db502bda82320b113 and project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:26:23.497593 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Going to run 1 instances... {{(pid=120617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:26:23.499993 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb7fd7c6-d6fd-45a5-907c-0ad57d0ef5d5',volume_size=None,volume_type=None)] {{(pid=120617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:26:23.632617 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-414d5790-b372-4c43-bfe5-5e8231cbdcfc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844927 Sep 10 14:26:23.633262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 612/1220] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:26:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:26:23.645080 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bf5b9a44-91b8-4013-bcae-eca258d9c926 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:23.645733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bf5b9a44-91b8-4013-bcae-eca258d9c926 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:23.705012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bf5b9a44-91b8-4013-bcae-eca258d9c926 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:23.712449 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bf5b9a44-91b8-4013-bcae-eca258d9c926 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1094 microversion: 2.1 time: 0.071226 Sep 10 14:26:23.713018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 609/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:23 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:24.735493 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:24.736111 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:24.742436 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:24.742948 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:24.744181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:24.744890 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:24.745342 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:24.745767 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:24.806178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:24.813710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-87405750-ccce-4e38-ac0d-55acc470addc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1144 microversion: 2.1 time: 0.082620 Sep 10 14:26:24.814297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 613/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:24 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:25.836912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:25.837632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:25.844758 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:25.845242 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:25.845677 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:25.846362 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:25.846827 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:25.847232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:25.907421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:25.915063 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-9e11abb5-5eab-493e-b3c1-20da8580fa46 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1144 microversion: 2.1 time: 0.082178 Sep 10 14:26:25.915650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 610/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:25 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:26.937567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:26.938236 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:26.944681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:26.945172 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:26.945609 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:26.946297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:26.946749 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:26.947173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:27.008773 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:27.016971 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b0037e31-22ed-4b37-82e3-05471b3a05f9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1144 microversion: 2.1 time: 0.083392 Sep 10 14:26:27.017538 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 614/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:26 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:28.039889 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:28.040522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:28.047202 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:28.047713 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:28.048582 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:28.049352 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:28.049814 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:28.050233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:28.114621 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:28.123635 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-5d36b3e4-72be-4639-a777-f008a37c335b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1136 microversion: 2.1 time: 0.087594 Sep 10 14:26:28.124205 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 611/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:28 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:29.147926 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:29.148518 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:29.155221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:29.155751 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:29.156317 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:29.157024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:29.157481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:29.157909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:29.222890 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:29.231384 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c9b3d7ee-6b4e-4736-ae1a-f60a1807c435 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1210 microversion: 2.1 time: 0.087337 Sep 10 14:26:29.231981 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 615/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:29 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:30.068463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-84adc211-f4f2-4a4d-8bff-545b86190ee4 req-54abb895-2fec-48a6-942b-cb929958c184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b68cfc6-292f-49e9-a776-67ac48b23b02", "tag": "e01064b1-7435-4e22-9852-af824ce7165c"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:26:30.078732 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-84adc211-f4f2-4a4d-8bff-545b86190ee4 req-54abb895-2fec-48a6-942b-cb929958c184 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:30.079197 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-84adc211-f4f2-4a4d-8bff-545b86190ee4 req-54abb895-2fec-48a6-942b-cb929958c184 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:30.079654 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-84adc211-f4f2-4a4d-8bff-545b86190ee4 req-54abb895-2fec-48a6-942b-cb929958c184 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:30.091360 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-84adc211-f4f2-4a4d-8bff-545b86190ee4 req-54abb895-2fec-48a6-942b-cb929958c184 service nova] Creating event network-changed:e01064b1-7435-4e22-9852-af824ce7165c for instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 on hv-cinder-85690 Sep 10 14:26:30.096193 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-84adc211-f4f2-4a4d-8bff-545b86190ee4 req-54abb895-2fec-48a6-942b-cb929958c184 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031639 Sep 10 14:26:30.096786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 612/1227] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:26:30.254548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:30.255262 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:30.261680 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:30.262267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:30.262706 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:30.263421 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:30.263980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:30.264406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:30.408369 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:30.417004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3ee90a28-24b9-4df7-8beb-10d4102003b4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.165821 Sep 10 14:26:30.417807 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 616/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:30 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:31.441857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:31.442574 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:31.450998 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:31.451525 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:31.451978 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:31.452690 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:31.453150 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:31.453580 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:31.683136 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:31.690852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b9246894-8972-4205-8459-8b7b7bc5ae2c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.253317 Sep 10 14:26:31.691536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 613/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:31 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:32.714630 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:32.715250 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:32.722196 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:32.722693 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:32.723152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:32.723944 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:32.724402 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:32.724833 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:32.874449 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:32.882190 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-809c0d99-8734-437a-8fe0-b5d5d6608ed5 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.172249 Sep 10 14:26:32.882762 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 617/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:32 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:33.905036 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:33.905670 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:33.911931 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:33.913396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:33.914171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:33.914617 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:33.915329 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:33.915877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:33.916305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:34.091252 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:34.100473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-607bbd64-692a-4f3c-9bbb-a555b1721163 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.199115 Sep 10 14:26:34.101048 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 614/1231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:33 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:35.126318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:35.127012 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:35.129067 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:35.129877 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=6 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:35.137355 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:35.137846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:35.138283 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:35.138978 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:35.139432 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:35.139876 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:35.279815 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:35.287614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-cac11034-1c64-4c4f-ab34-d76f856c6cde tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.165530 Sep 10 14:26:35.288185 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 618/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:35 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:36.310737 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:36.312097 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:36.318448 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:36.318937 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:36.319380 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:36.320104 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:36.320566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:36.320994 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:36.462960 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:36.471312 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-41c60308-9628-4d3f-b9ab-045f4ed23af1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.164580 Sep 10 14:26:36.472101 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 615/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:36 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:37.495367 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:37.496019 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:37.502337 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:37.502810 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:37.503239 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:37.503950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:37.504400 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:37.504817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:37.638073 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:37.646572 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8171628c-2465-446b-a7c2-8b72d149089e tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.155263 Sep 10 14:26:37.647122 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 619/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:37 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:38.670926 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:38.671566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:38.678172 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:38.678675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:38.679114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:38.679821 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:38.680274 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:38.680694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:38.812701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:38.820411 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ce525de1-28ad-4633-8a66-d90c7cbbfca9 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.154211 Sep 10 14:26:38.820967 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 616/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:38 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:39.843785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:39.844586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:39.851024 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:39.851660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:39.852100 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:39.852791 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:39.853248 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:39.853671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:39.991753 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:40.000349 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5bc8f68b-2a67-4646-b199-3e6e6d4e0680 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.160481 Sep 10 14:26:40.000927 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 620/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:39 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:26:41.022509 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:41.023974 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:41.030930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:41.031496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:41.031996 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:41.032816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:41.033245 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:41.033661 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:41.171587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:41.179762 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-fd4aa303-b4cb-47a6-b32b-4145bf258cb6 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.161344 Sep 10 14:26:41.194616 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 617/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:41 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:42.202573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:42.203193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:42.209933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:42.210426 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:42.210866 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:42.211593 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:42.212052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:42.212488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:42.350007 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:42.357878 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a3866572-0c9b-44d4-bc17-4e387a1d7dbb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.159489 Sep 10 14:26:42.358447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 621/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:42 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:43.382023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:43.382559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:43.384595 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:43.390885 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:43.391389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:43.391853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:43.392536 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:43.393004 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:43.393467 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:43.397987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:43.536488 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:43.544919 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-69f8f554-ad98-4d01-8b68-16071233b800 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.167088 Sep 10 14:26:43.545485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 618/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:43 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:44.567376 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:44.568040 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:44.570321 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:44.576201 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:44.577245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:44.577373 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:44.578016 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:44.578406 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:44.579470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:44.584792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=93 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:26:44.718785 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:44.726717 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0e054ef9-9b6c-45a4-a073-518a88a3cd6a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.163175 Sep 10 14:26:44.727302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 622/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:44 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:45.752517 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:45.753459 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:45.763528 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:45.764447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:45.764982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:45.765751 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:45.766432 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:45.767054 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:45.920615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:45.928571 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1b5189b3-d3e0-4566-8d12-5489a0af02cb tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.181898 Sep 10 14:26:45.929259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 619/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:45 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:26:46.952193 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:46.952879 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:46.960792 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:46.961279 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:46.961720 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:46.962422 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:46.963119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:46.963517 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:47.116929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:47.125564 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-c8584ca9-6e3b-4c89-a0d4-af89a14ac117 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.177529 Sep 10 14:26:47.127669 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 623/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:46 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:48.149430 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:48.150174 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:48.157373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:48.157866 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:48.158556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:48.159486 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:48.159950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:48.160376 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:48.317554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:48.325627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d6524d36-f5ee-43ff-bc8e-605517dfe1fc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.180529 Sep 10 14:26:48.339495 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 620/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:48 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:49.349988 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:49.350824 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:49.357800 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:49.358280 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:49.358712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:49.359401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:49.359875 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:49.360296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:49.502084 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:49.509660 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-1bebc761-c710-431c-8783-56c6d9318418 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.163617 Sep 10 14:26:49.510224 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 624/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:49 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:50.532760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:50.533720 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:50.539877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:50.540351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:50.540787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:50.542199 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:50.542656 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:50.543083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:50.703823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:50.711760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-c5386a3e-0ed2-4fd1-be2f-be21af28da2a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.182793 Sep 10 14:26:50.712626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 621/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:50 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:26:51.734448 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:51.735312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:51.742435 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:51.742933 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:51.743372 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:51.744144 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:51.745203 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:51.745844 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:51.888548 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:51.896307 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-dfa824a1-f5b7-4a24-b7dd-e67e5eb01223 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.165742 Sep 10 14:26:51.896864 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 625/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:51 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:26:52.424000 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-68867472-afec-412a-9358-e6d6d613c03f req-29159611-09b5-4cf6-aa45-a835cbb15232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b68cfc6-292f-49e9-a776-67ac48b23b02", "name": "network-vif-plugged", "status": "completed", "tag": "e01064b1-7435-4e22-9852-af824ce7165c"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:26:52.434235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-68867472-afec-412a-9358-e6d6d613c03f req-29159611-09b5-4cf6-aa45-a835cbb15232 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:52.434717 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-68867472-afec-412a-9358-e6d6d613c03f req-29159611-09b5-4cf6-aa45-a835cbb15232 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:52.435164 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-68867472-afec-412a-9358-e6d6d613c03f req-29159611-09b5-4cf6-aa45-a835cbb15232 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:52.446956 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-68867472-afec-412a-9358-e6d6d613c03f req-29159611-09b5-4cf6-aa45-a835cbb15232 service nova] Creating event network-vif-plugged:e01064b1-7435-4e22-9852-af824ce7165c for instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 on hv-cinder-85690 Sep 10 14:26:52.451984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-68867472-afec-412a-9358-e6d6d613c03f req-29159611-09b5-4cf6-aa45-a835cbb15232 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227166 Sep 10 14:26:52.452865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 622/1247] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:26:52.918641 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:52.919253 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:52.925734 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:52.926221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:52.926655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:52.927586 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:52.928067 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:52.928527 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:53.061469 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:53.069245 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-f6918e54-2de7-403b-b88a-f97431d182ca tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.155147 Sep 10 14:26:53.069819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 626/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:52 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:54.093575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:54.094279 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:54.100424 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:54.100903 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:54.101335 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:54.102018 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:54.102475 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:54.102893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:54.231327 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:54.239267 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-2306e678-f1d7-49ff-9eb4-7ff92dbc8d55 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.150565 Sep 10 14:26:54.239864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 623/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:54 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:55.262502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:55.263120 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:55.269553 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:55.270042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:55.270481 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:55.271170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:55.271667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:55.272093 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:55.403302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:55.411003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6ce08d93-8234-4247-aa0f-8ed3844a69f3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.152683 Sep 10 14:26:55.411602 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 627/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:55 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:56.434186 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:56.434804 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:56.441426 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:56.441916 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:56.442351 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:56.443049 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:56.443532 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:56.443963 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:56.577374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:56.585049 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1bf4404f-33b6-4936-8c6b-6cc8e35cbda3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1266 microversion: 2.1 time: 0.154916 Sep 10 14:26:56.585611 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 624/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:56 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:57.609052 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:57.609685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:57.616663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:57.617142 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:57.617600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:57.618286 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:57.618738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:57.619154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:57.774865 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:57.784232 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fb6299ca-34dc-4cfb-a273-a8782de7d81c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1454 microversion: 2.1 time: 0.178723 Sep 10 14:26:57.784585 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 628/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:57 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:57.812035 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:26:57.812685 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:26:57.819824 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:57.820320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:57.821427 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:57.822138 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:57.822644 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:57.823612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:58.007050 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:26:58.016534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4761bc6a-2241-45e7-a7db-b3c6d28db345 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1454 microversion: 2.1 time: 0.208297 Sep 10 14:26:58.017399 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 625/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:26:57 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1454 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:26:59.939018 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-dd0a8a39-d40f-45d2-8a36-669defc4d2dc req-537727b4-cdac-461f-847e-631d9e025ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b68cfc6-292f-49e9-a776-67ac48b23b02", "tag": "e01064b1-7435-4e22-9852-af824ce7165c"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:26:59.949385 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dd0a8a39-d40f-45d2-8a36-669defc4d2dc req-537727b4-cdac-461f-847e-631d9e025ca4 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:26:59.949768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dd0a8a39-d40f-45d2-8a36-669defc4d2dc req-537727b4-cdac-461f-847e-631d9e025ca4 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:26:59.950197 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-dd0a8a39-d40f-45d2-8a36-669defc4d2dc req-537727b4-cdac-461f-847e-631d9e025ca4 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:26:59.962268 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-dd0a8a39-d40f-45d2-8a36-669defc4d2dc req-537727b4-cdac-461f-847e-631d9e025ca4 service nova] Creating event network-changed:e01064b1-7435-4e22-9852-af824ce7165c for instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 on hv-cinder-85690 Sep 10 14:26:59.968703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-dd0a8a39-d40f-45d2-8a36-669defc4d2dc req-537727b4-cdac-461f-847e-631d9e025ca4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033571 Sep 10 14:26:59.969467 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 629/1254] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:27:01.448143 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:27:01.448787 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:01.455238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:01.455748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:01.456178 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:01.456893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:01.457341 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:01.457757 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:01.480013 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.objects.instance [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lazy-loading 'flavor' on Instance uuid afc30b64-f5bc-4234-bfab-d3421f17e258 {{(pid=120616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 14:27:01.552167 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-cb678d85-6bd8-432b-a095-ffd206d55838 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "POST /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258/action" status: 202 len: 0 microversion: 2.1 time: 0.107652 Sep 10 14:27:01.552864 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 626/1255] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:27:01 2022] POST /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:27:01.562874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:01.563595 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:01.572340 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:01.573096 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:01.573837 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:01.574539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:01.575021 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:01.575967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:01.719639 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:01.727417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-769c0afb-13fe-4534-86e9-ce9ff9b51df3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.169549 Sep 10 14:27:01.728003 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 630/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:01 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:02.753765 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:02.754636 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:02.761712 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:02.762235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:02.763233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:02.764160 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:02.764668 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:02.765099 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:02.917768 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:02.926171 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-80fe4c81-5ed3-419e-afcc-39c33d7c1025 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.177186 Sep 10 14:27:02.926760 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 627/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:02 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:03.949681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:03.950399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:03.957605 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:03.958095 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:03.958534 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:03.959258 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:03.959874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:03.960297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:04.092145 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:04.100738 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-a1fb2fb1-5632-4f15-87b7-f52c28320e4d tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.155104 Sep 10 14:27:04.101302 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 631/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:03 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:05.127966 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:05.128507 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:05.135972 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:05.136463 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:05.136914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:05.137653 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:05.138115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:05.138570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:05.273524 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:05.281383 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bf03b802-bb39-4087-a6f7-54a81f6fa9ac tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.157388 Sep 10 14:27:05.282535 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 628/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:05 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:06.305287 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:06.305889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:06.312394 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:06.312974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:06.313418 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:06.314116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:06.314575 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:06.315004 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:06.460552 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:06.469891 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-d564733d-abcb-4f8a-929a-f3585704a866 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.167584 Sep 10 14:27:06.470490 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 632/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:06 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:07.493816 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:07.494419 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:07.501090 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:07.501576 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:07.502016 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:07.503238 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:07.503722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:07.504152 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:07.647894 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:07.656259 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-311a18d9-2779-4828-b2ca-0787eeba04f7 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.166303 Sep 10 14:27:07.656839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 629/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:07 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:08.680170 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:08.680991 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:08.687974 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:08.688468 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:08.688909 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:08.690077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:08.690077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:08.690514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:08.844281 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:08.852880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e5275a93-c5c7-4a3f-9a2f-fb4534fa67b5 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.177193 Sep 10 14:27:08.853451 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 633/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:08 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:09.877332 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:09.877930 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:09.884554 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:09.885064 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:09.885527 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:09.886217 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:09.886730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:09.887160 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:10.029483 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:10.037337 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-7314cb0c-eb50-467e-9b82-6b7fd6869fb1 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.163842 Sep 10 14:27:10.037893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 630/1263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:09 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:11.061271 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:11.061824 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:11.068230 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:11.068719 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:11.069657 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:11.070712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:11.071205 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:11.071661 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:11.208656 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:11.217046 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-28d4fa12-b4d3-40d9-bdc1-0943b3e4fa62 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.159855 Sep 10 14:27:11.217623 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 634/1264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:11 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:12.240777 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:12.241566 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:12.247702 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:12.248322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:12.248870 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:12.249634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:12.250165 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:12.250657 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:12.457056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:12.465730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-4c67aadb-76d0-43a7-b8b9-d7bcb57c1ccb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.229346 Sep 10 14:27:12.466288 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 631/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:12 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:13.489474 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:13.490087 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:13.496697 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:13.497180 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:13.497614 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:13.498301 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:13.498754 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:13.499178 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:13.630045 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:13.638375 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-593c8274-5c86-4a56-bfdc-bb282b00a524 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.153027 Sep 10 14:27:13.638942 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 635/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:13 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:27:14.662458 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:14.663253 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:14.666243 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=28 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:27:14.671612 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:14.672098 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:14.672529 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:14.673220 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:14.673665 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:14.674079 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:14.678214 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:27:14.810600 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:14.818438 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1c6f6b7b-125a-4290-a8b0-7244c07a3969 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.160486 Sep 10 14:27:14.819575 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 632/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:14 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:15.843478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:15.844041 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:15.846478 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=28 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:27:15.852640 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:15.853154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:15.853584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:15.854267 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:15.854721 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:15.855136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:15.857913 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=80 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:27:15.989487 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:15.997212 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-b706cc66-19f0-4a2f-871c-a7032e635618 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1511 microversion: 2.1 time: 0.157767 Sep 10 14:27:15.997768 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 636/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:15 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:16.020233 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:27:16.020820 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:16.028045 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:16.028521 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:16.028950 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:16.029627 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:16.030076 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:16.030494 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:16.058917 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120616) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 14:27:16.130947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-de97d102-1f68-442d-81c4-2bec7cbf3679 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "POST /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258/action" status: 202 len: 0 microversion: 2.1 time: 0.115356 Sep 10 14:27:16.131606 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 633/1269] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 10 14:27:16 2022] POST /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:27:16.140419 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:16.141034 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:16.147486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:16.147486 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:16.147880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:16.148573 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:16.149261 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:16.149590 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:16.297620 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:16.307808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-e3998cd9-cafe-42b1-bfe5-b4a620907573 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1519 microversion: 2.1 time: 0.171130 Sep 10 14:27:16.308671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 637/1270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:16 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:17.331727 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:17.332254 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:17.338452 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:17.338929 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:17.339357 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:17.340068 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:17.340516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:17.340990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:17.477434 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:17.486390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-41fb6140-57be-4d9d-a4e8-046d6756cdf4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1521 microversion: 2.1 time: 0.159079 Sep 10 14:27:17.487213 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 634/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:17 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:18.355221 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-02a71f43-b139-499c-b28a-2e1347a12d95 req-a673864d-6521-4c87-82d6-8ee47b25d226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "name": "network-vif-unplugged", "status": "completed", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:27:18.367295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-02a71f43-b139-499c-b28a-2e1347a12d95 req-a673864d-6521-4c87-82d6-8ee47b25d226 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:18.367870 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-02a71f43-b139-499c-b28a-2e1347a12d95 req-a673864d-6521-4c87-82d6-8ee47b25d226 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:18.368297 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-02a71f43-b139-499c-b28a-2e1347a12d95 req-a673864d-6521-4c87-82d6-8ee47b25d226 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:18.380080 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-02a71f43-b139-499c-b28a-2e1347a12d95 req-a673864d-6521-4c87-82d6-8ee47b25d226 service nova] Creating event network-vif-unplugged:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:27:18.385309 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-02a71f43-b139-499c-b28a-2e1347a12d95 req-a673864d-6521-4c87-82d6-8ee47b25d226 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035254 Sep 10 14:27:18.386152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 638/1272] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:27:18.511191 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:18.511860 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:18.518496 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:18.518987 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:18.519429 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:18.520219 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:18.520678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:18.521116 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:18.761834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:18.769546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3c5e54d0-b288-4d2e-8c33-f5ea97882bfb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.262784 Sep 10 14:27:18.770115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 635/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:18 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:19.794683 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:19.795395 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:19.801631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:19.802116 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:19.802557 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:19.803260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:19.803740 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:19.804168 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:19.937816 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:19.945929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-9c156260-68b2-4791-9b6c-902c8fac34fb tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.155739 Sep 10 14:27:19.946488 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 639/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:19 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:20.969559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:20.970166 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:20.977391 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:20.977939 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:20.978374 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:20.979060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:20.979533 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:20.979983 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:21.110422 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:21.118593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-43f4237d-b28f-447d-a341-60d1eeb34f48 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.152923 Sep 10 14:27:21.119188 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 636/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:20 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:22.141789 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:22.142492 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:22.149160 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:22.149846 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:22.150296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:22.150980 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:22.151434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:22.151880 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:22.284502 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:22.293055 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-df3c1fb8-40ea-47f8-aa98-aaeb705c94ff tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.155163 Sep 10 14:27:22.293631 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 640/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:22 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:23.317029 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:23.317573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:23.324979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:23.325459 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:23.325892 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:23.326576 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:23.327023 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:23.327453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:23.461687 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:23.469792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8d4f27a6-8780-4ffe-b9e7-b31bcb4f3a7c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.156738 Sep 10 14:27:23.470534 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 637/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:23 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:24.492497 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:24.493182 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:24.499459 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:24.499945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:24.500378 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:24.501062 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:24.501514 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:24.501936 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:24.632069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:24.640256 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-fb1dfc1a-ecc8-472f-8f2a-ab1e6f5ab8a4 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.151581 Sep 10 14:27:24.640819 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 641/1278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:24 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:25.663774 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:25.664385 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:25.670945 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:25.671421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:25.671884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:25.672559 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:25.673010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:25.673424 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:25.803764 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:25.812085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-eaa7d753-78f4-44ad-ac53-810ed59f40ad tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.152360 Sep 10 14:27:25.812646 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 638/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:25 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:26.835437 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:26.836069 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:26.842685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:26.843158 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:26.843618 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:26.844303 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:26.844747 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:26.845161 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:26.980543 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:26.988737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ae5e244e-b556-4ab0-915e-95ee160765b3 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.157116 Sep 10 14:27:26.989312 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 642/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:26 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:28.013573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:28.014221 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:28.020640 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:28.021120 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:28.021550 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:28.022230 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:28.022675 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:28.023089 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:28.158453 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:28.166626 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-ca968cb8-4310-4fde-9656-a80b0c8df591 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1577 microversion: 2.1 time: 0.157253 Sep 10 14:27:28.167200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 639/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:28 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:29.192442 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:27:29.193136 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:27:29.201330 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:29.201735 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:29.202181 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:29.202869 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:29.203318 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:29.203765 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:29.345999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:27:29.354634 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-132274e3-6dde-4011-9d8a-bf66092ce96b tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1564 microversion: 2.1 time: 0.166997 Sep 10 14:27:29.355234 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 643/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:27:29 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:27:30.455698 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-cdc5492d-b824-46ff-a5b3-13d2780379d2 req-83b46b0e-e015-4a57-b047-64e8f8b9876d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "name": "network-vif-plugged", "status": "completed", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:27:30.465985 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-cdc5492d-b824-46ff-a5b3-13d2780379d2 req-83b46b0e-e015-4a57-b047-64e8f8b9876d service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:27:30.466485 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-cdc5492d-b824-46ff-a5b3-13d2780379d2 req-83b46b0e-e015-4a57-b047-64e8f8b9876d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:27:30.466914 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-cdc5492d-b824-46ff-a5b3-13d2780379d2 req-83b46b0e-e015-4a57-b047-64e8f8b9876d service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:27:30.478775 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-cdc5492d-b824-46ff-a5b3-13d2780379d2 req-83b46b0e-e015-4a57-b047-64e8f8b9876d service nova] Creating event network-vif-plugged:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:27:30.483792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-cdc5492d-b824-46ff-a5b3-13d2780379d2 req-83b46b0e-e015-4a57-b047-64e8f8b9876d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Sep 10 14:27:30.484403 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 640/1283] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:28:59.433391 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:28:59.435056 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:28:59.436389 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:28:59.437236 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:28:59.437375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Sat Sep 10 14:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 10 14:28:59.440998 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:28:59.443315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=15 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:28:59.443990 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=43 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:28:59.444806 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:28:59.444929 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sat Sep 10 14:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 (ip 10.222.0.26) !!! Sep 10 14:28:59.449291 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-08ea2cb3-ae08-4f3b-ba17-03fbf637edbc req-179e2bf2-f130-44e1-b72c-fe1cecf48ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:28:59.454957 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:28:59.455796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:28:59.456545 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:28:59.457450 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:28:59.458077 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:28:59.458550 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:28:59.463241 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-08ea2cb3-ae08-4f3b-ba17-03fbf637edbc req-179e2bf2-f130-44e1-b72c-fe1cecf48ca9 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:28:59.463809 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-08ea2cb3-ae08-4f3b-ba17-03fbf637edbc req-179e2bf2-f130-44e1-b72c-fe1cecf48ca9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:28:59.464418 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-08ea2cb3-ae08-4f3b-ba17-03fbf637edbc req-179e2bf2-f130-44e1-b72c-fe1cecf48ca9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:28:59.478530 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-08ea2cb3-ae08-4f3b-ba17-03fbf637edbc req-179e2bf2-f130-44e1-b72c-fe1cecf48ca9 service nova] Creating event network-changed:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:28:59.484678 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-08ea2cb3-ae08-4f3b-ba17-03fbf637edbc req-179e2bf2-f130-44e1-b72c-fe1cecf48ca9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056690 Sep 10 14:28:59.485792 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 641/1284] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:28:59.487940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:28:59.568305 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5ca858a4-76bf-4560-b3da-59fde471577c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "DELETE /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 204 len: 0 microversion: 2.1 time: 0.143290 Sep 10 14:28:59.572119 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 644/1285] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:28:59 2022] DELETE /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:28:59.578084 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:28:59.578811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:28:59.585884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:28:59.586473 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:28:59.586979 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:28:59.587781 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:28:59.588277 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:28:59.588790 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:28:59.840539 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:28:59.848324 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-84a7108c-7ce9-43fb-b469-02e9c9280846 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.274484 Sep 10 14:28:59.848888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 642/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:28:59 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:29:00.874571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:00.875412 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:00.882184 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:00.882668 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:00.883109 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:00.884064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:00.884532 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:00.885689 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:01.130784 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:01.143939 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2df5f948-8589-4d40-b488-941b0c0d8c32 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1570 microversion: 2.1 time: 0.274426 Sep 10 14:29:01.144530 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 645/1287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:00 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1570 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:01.975065 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-201642e4-acc3-4380-9496-6903503ccf86 req-66fcb3eb-126a-41d9-9d0f-9367585db3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc30b64-f5bc-4234-bfab-d3421f17e258", "name": "network-vif-deleted", "tag": "344c0846-7863-41cb-8046-79bb6b4d482b"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:29:01.984953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-201642e4-acc3-4380-9496-6903503ccf86 req-66fcb3eb-126a-41d9-9d0f-9367585db3c9 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:01.986645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-201642e4-acc3-4380-9496-6903503ccf86 req-66fcb3eb-126a-41d9-9d0f-9367585db3c9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:01.987115 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-201642e4-acc3-4380-9496-6903503ccf86 req-66fcb3eb-126a-41d9-9d0f-9367585db3c9 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:01.998573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-201642e4-acc3-4380-9496-6903503ccf86 req-66fcb3eb-126a-41d9-9d0f-9367585db3c9 service nova] Creating event network-vif-deleted:344c0846-7863-41cb-8046-79bb6b4d482b for instance afc30b64-f5bc-4234-bfab-d3421f17e258 on hv-cinder-85690 Sep 10 14:29:02.003703 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-201642e4-acc3-4380-9496-6903503ccf86 req-66fcb3eb-126a-41d9-9d0f-9367585db3c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096804 Sep 10 14:29:02.004371 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 643/1288] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:29:02.170229 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:02.171489 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:02.178135 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:02.178626 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:02.179066 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:02.179796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:02.180254 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:02.180710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:02.245992 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13d21124dbf41459543426847b67bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ebb6e9554f4c0d985bf90411a4e36f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:02.254215 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-3bef52c8-cee9-4017-b346-36793d8baa8c tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 200 len: 1220 microversion: 2.1 time: 0.088315 Sep 10 14:29:02.254804 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 646/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:02 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:03.278028 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:03.278733 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] [instance: afc30b64-f5bc-4234-bfab-d3421f17e258] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:03.284934 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:03.285421 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:03.285857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:03.286548 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:03.287012 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:03.287466 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:03.300953 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] HTTP exception thrown: Instance afc30b64-f5bc-4234-bfab-d3421f17e258 could not be found. Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Request method failure captured: Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 HTTP/1.1 Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ3Q7FRyDW5bWIAD6xU94_cbRrKPd_0K1AI1g90mDAB9_TTinS-BQDEr1fptA04Q5nR1dYSzlkUoS1nPUq1Pr-5Zf1Ein_avPpqE-j6SN09BmcAt1tyc_MMbUAsv_HXvU9Tn4tokVNyHEymUGlIscN5Pen6Wm_o6WlEKkAutBctc9U0 Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: b4ebb6e9554f4c0d985bf90411a4e36f Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestShelveInstance-1757932808 Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:29:03.302546 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4ebb6e9554f4c0d985bf90411a4e36f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4ebb6e9554f4c0d985bf90411a4e36f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4ebb6e9554f4c0d985bf90411a4e36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4ebb6e9554f4c0d985bf90411a4e36f"}]}] Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestShelveInstance-1757932808 Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: b4ebb6e9554f4c0d985bf90411a4e36f Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestShelveInstance-1757932808 Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestShelveInstance-1757932808-project Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: b13d21124dbf41459543426847b67bea Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestShelveInstance-1757932808-project Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance afc30b64-f5bc-4234-bfab-d3421f17e258 could not be found. Sep 10 14:29:03.304382 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': 'afc30b64-f5bc-4234-bfab-d3421f17e258'} Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc30b64-f5bc-4234-bfab-d3421f17e258 could not be found. Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:29:03.305465 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc30b64-f5bc-4234-bfab-d3421f17e258 could not be found. Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc30b64-f5bc-4234-bfab-d3421f17e258 could not be found. Sep 10 14:29:03.308046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:29:03.309645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Returning 404 to user: Instance afc30b64-f5bc-4234-bfab-d3421f17e258 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:29:03.309645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-bb14eb72-85b2-475c-bdfa-d81876e2d771 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258" status: 404 len: 111 microversion: 2.1 time: 0.030713 Sep 10 14:29:03.309645 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 644/1290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:03 2022] GET /compute/v2.1/servers/afc30b64-f5bc-4234-bfab-d3421f17e258 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:29:03.466591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ffba685f-8e0b-4fd6-9a2d-a63ef27f01d8 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] Calling method '.version_select at 0x7ff6b7301040>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:03.493042 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ffba685f-8e0b-4fd6-9a2d-a63ef27f01d8 tempest-TestShelveInstance-1757932808 tempest-TestShelveInstance-1757932808-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1695897523" status: 202 len: 0 microversion: 2.1 time: 0.030193 Sep 10 14:29:03.493648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 647/1291] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Sep 10 14:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1695897523 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 14:29:12.768296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-982024335", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1666901075", "security_groups": [{"name": "tempest-secgroup-smoke-1642103404"}], "block_device_mapping_v2": [{"uuid": "398b6050-3f05-41af-b33a-5a56ac86ae18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "50038936-7823-499b-a2d7-942d23b9f352"}]}} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:29:12.882802 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.network.neutron [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] validate_networks() for [('50038936-7823-499b-a2d7-942d23b9f352', None, None, None, None, None)] {{(pid=120616) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 14:29:13.292181 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=12 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:13.357796 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Flavor limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 14:29:13.358223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Image limits 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 14:29:13.358701 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Flavor pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 14:29:13.359114 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Image pref 0:0:0 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 14:29:13.359593 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.virt.hardware [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 14:29:13.368474 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:13.369588 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:13.370108 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:13.370839 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:13.371303 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:13.371745 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:13.389044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 14:29:13.393223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.quota [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Getting quotas for user f4638a1936f5467db502bda82320b113 and project c8d41b873ac94a33beb63a2d89a218ff. Resources: {'ram', 'instances', 'cores'} {{(pid=120616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 14:29:13.451366 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Going to run 1 instances... {{(pid=120616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 14:29:13.453520 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='398b6050-3f05-41af-b33a-5a56ac86ae18',volume_size=None,volume_type=None)] {{(pid=120616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 14:29:13.579831 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-1a5c70b8-65c2-44ee-8582-bd1fe30f904b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815375 Sep 10 14:29:13.580490 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 645/1292] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 10 14:29:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 14:29:13.589896 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:13.590937 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:13.595064 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-77b56157-fab1-4715-b9a9-11b2a0f6e87c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:13.595703 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-77b56157-fab1-4715-b9a9-11b2a0f6e87c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:13.657782 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-77b56157-fab1-4715-b9a9-11b2a0f6e87c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:13.664831 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-77b56157-fab1-4715-b9a9-11b2a0f6e87c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1094 microversion: 2.1 time: 0.077074 Sep 10 14:29:13.665407 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 648/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:13 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:14.687373 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:14.688157 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:14.696044 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:14.696556 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:14.697634 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:14.698410 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:14.699074 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:14.699527 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:14.762587 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:14.771893 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e090f464-22c0-4f55-b97a-78430529513d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1210 microversion: 2.1 time: 0.088182 Sep 10 14:29:14.772782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 646/1294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:14 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:15.796489 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:15.797365 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:15.804356 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:15.804860 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:15.805291 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:15.805999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:15.806862 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:15.807296 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:16.031194 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:16.039417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2a97d1c8-8b61-4436-a875-7bc938093a56 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.247173 Sep 10 14:29:16.040098 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 649/1295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:15 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:16.139830 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-113d8fa9-83e4-4aa4-af0a-8597b0ba20da req-f74732d6-3b4e-4d2f-976c-8acc876bc801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62", "tag": "709c4260-99eb-4169-b1f4-c828ecc332b7"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:29:16.151722 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-113d8fa9-83e4-4aa4-af0a-8597b0ba20da req-f74732d6-3b4e-4d2f-976c-8acc876bc801 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:16.152300 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-113d8fa9-83e4-4aa4-af0a-8597b0ba20da req-f74732d6-3b4e-4d2f-976c-8acc876bc801 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:16.152984 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-113d8fa9-83e4-4aa4-af0a-8597b0ba20da req-f74732d6-3b4e-4d2f-976c-8acc876bc801 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:16.164200 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-113d8fa9-83e4-4aa4-af0a-8597b0ba20da req-f74732d6-3b4e-4d2f-976c-8acc876bc801 service nova] Creating event network-changed:709c4260-99eb-4169-b1f4-c828ecc332b7 for instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 on hv-cinder-85690 Sep 10 14:29:16.169060 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-113d8fa9-83e4-4aa4-af0a-8597b0ba20da req-f74732d6-3b4e-4d2f-976c-8acc876bc801 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032978 Sep 10 14:29:16.169650 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 647/1296] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:29:17.065801 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:17.066417 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:17.072921 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:17.073401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:17.073836 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:17.074521 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:17.074975 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:17.075399 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:17.211945 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:17.220285 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-dd009b24-695f-429e-8b3f-b6a5fb2deae7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.158336 Sep 10 14:29:17.220856 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 650/1297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:17 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:18.243241 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:18.244843 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:18.251005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:18.251516 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:18.251951 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:18.252633 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:18.253085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:18.253506 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:18.390085 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:18.397846 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-457fca06-20af-4dd2-995f-147b87abcbd4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.159192 Sep 10 14:29:18.398407 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 648/1298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:18 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:19.420491 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:19.421107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:19.427592 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:19.428085 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:19.428524 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:19.429220 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:19.429671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:19.430103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:19.562053 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:19.569737 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-33a753f1-a1f8-4cc2-a8e1-50ae2e31a549 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.153139 Sep 10 14:29:19.570315 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 651/1299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:19 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:20.593245 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:20.593857 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:20.600256 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:20.600731 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:20.601158 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:20.601834 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:20.602281 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:20.602694 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:20.733249 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:20.741148 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-566dc5a2-0315-455b-bb97-ba4cde4e4774 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.151714 Sep 10 14:29:20.741705 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 649/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:20 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:21.763796 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:21.764361 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:21.770685 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:21.771163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:21.771628 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:21.772313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:21.772794 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:21.773216 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:21.901546 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:21.909103 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-8f83ad6c-fc02-4503-9f03-f5ebda6e1d8a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.149318 Sep 10 14:29:21.909670 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 652/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:21 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:22.932905 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:22.933523 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:22.939961 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:22.940447 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:22.940888 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:22.941615 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:22.942073 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:22.942503 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:23.069810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:23.077971 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-02ac4eac-51fc-48eb-a8a3-1fbdb555d19c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.149619 Sep 10 14:29:23.078531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 650/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:22 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:24.101494 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:24.102013 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:24.104472 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell0:SELECT=2 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:24.109803 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:24.110281 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:24.110977 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:24.111696 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:24.112154 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:24.112578 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:24.245447 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:24.253146 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-5896dc53-ddab-4223-b6f4-ee8e62026e5a tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.155648 Sep 10 14:29:24.253712 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 653/1303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:24 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:25.276333 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:25.276982 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:25.278895 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=2 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:25.279583 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell0:SELECT=6 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:25.286730 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:25.287393 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:25.287854 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:25.288544 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:25.288995 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:25.289417 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:25.424037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:25.432222 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-99e24c70-6092-4550-85c1-3ba0875b2d6d tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.159818 Sep 10 14:29:25.432882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 651/1304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:25 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:26.454655 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:26.455273 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:26.461671 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:26.462155 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:26.462596 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:26.463284 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:26.463771 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:26.464195 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:26.593728 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:26.601278 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-7d92f20a-3ac1-4c3e-89b4-b1a2ec671dc1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.150516 Sep 10 14:29:26.601849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 654/1305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:26 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:27.577811 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-cffc7098-718d-4683-b869-16214245db31 req-36b547d7-61ee-40f8-b1e3-2be059512c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62", "name": "network-vif-plugged", "status": "completed", "tag": "709c4260-99eb-4169-b1f4-c828ecc332b7"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:29:27.587882 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-cffc7098-718d-4683-b869-16214245db31 req-36b547d7-61ee-40f8-b1e3-2be059512c67 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:27.588353 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-cffc7098-718d-4683-b869-16214245db31 req-36b547d7-61ee-40f8-b1e3-2be059512c67 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:27.588779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-cffc7098-718d-4683-b869-16214245db31 req-36b547d7-61ee-40f8-b1e3-2be059512c67 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:27.601471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-cffc7098-718d-4683-b869-16214245db31 req-36b547d7-61ee-40f8-b1e3-2be059512c67 service nova] Creating event network-vif-plugged:709c4260-99eb-4169-b1f4-c828ecc332b7 for instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 on hv-cinder-85690 Sep 10 14:29:27.607235 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-cffc7098-718d-4683-b869-16214245db31 req-36b547d7-61ee-40f8-b1e3-2be059512c67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 Sep 10 14:29:27.608043 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 652/1306] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:29:27.625192 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:27.625805 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:27.632173 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:27.632667 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:27.633089 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:27.633798 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:27.634288 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:27.634710 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:27.773999 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:27.782567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-6e70fe31-675b-4d63-a91b-7f4a7acaeb7b tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.161276 Sep 10 14:29:27.783152 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 655/1307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:27 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:28.806548 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:28.807255 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:28.813406 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:28.813884 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:28.814320 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:28.815002 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:28.815472 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:28.815896 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:28.949404 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:28.957305 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-d554e44e-5a48-46ce-8307-6a275e2576f7 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1266 microversion: 2.1 time: 0.155617 Sep 10 14:29:28.957865 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 653/1308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:28 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 14:29:29.980732 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:29.981350 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:29.987828 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:29.988313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:29.988750 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:29.989436 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:29.989888 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:29.990310 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:30.119409 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:30.127072 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-0021c46c-8424-4184-b4de-a384fe09cb96 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1454 microversion: 2.1 time: 0.150486 Sep 10 14:29:30.127681 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 656/1309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:29 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:30.149003 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:29:30.150346 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:29:30.152899 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:29:30.158318 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:30.158795 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:30.159223 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:30.159941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:30.160390 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:30.160810 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:30.293396 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:29:30.301020 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-e9605c1d-b8f5-43fb-9e96-700933357ec3 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1454 microversion: 2.1 time: 0.155844 Sep 10 14:29:30.301573 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 654/1310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:29:30 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:29:32.223352 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-249bcd42-d58f-46ac-9c16-29e0f3655356 req-90c1c774-b016-4bc8-a7cf-79c895b91e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62", "tag": "709c4260-99eb-4169-b1f4-c828ecc332b7"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:29:32.233632 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-249bcd42-d58f-46ac-9c16-29e0f3655356 req-90c1c774-b016-4bc8-a7cf-79c895b91e83 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:29:32.234112 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-249bcd42-d58f-46ac-9c16-29e0f3655356 req-90c1c774-b016-4bc8-a7cf-79c895b91e83 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:29:32.234539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-249bcd42-d58f-46ac-9c16-29e0f3655356 req-90c1c774-b016-4bc8-a7cf-79c895b91e83 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:29:32.248571 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-249bcd42-d58f-46ac-9c16-29e0f3655356 req-90c1c774-b016-4bc8-a7cf-79c895b91e83 service nova] Creating event network-changed:709c4260-99eb-4169-b1f4-c828ecc332b7 for instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 on hv-cinder-85690 Sep 10 14:29:32.253565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-249bcd42-d58f-46ac-9c16-29e0f3655356 req-90c1c774-b016-4bc8-a7cf-79c895b91e83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033857 Sep 10 14:29:32.254147 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 657/1311] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:31:22.014977 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_api:SELECT=1 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:31:22.016232 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG dbcounter [-] [120616] Writing DB stats nova_cell1:SELECT=48 {{(pid=120616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:31:22.019076 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_api:SELECT=22 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:31:22.019941 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG dbcounter [-] [120617] Writing DB stats nova_cell1:SELECT=50 {{(pid=120617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 14:31:22.020990 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:22.021215 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 14:31:22.021343 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Sat Sep 10 14:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 10 14:31:22.021522 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:22.030748 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:22.031688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:22.031688 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:22.032780 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:22.033289 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:22.033714 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:22.061471 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Going to try to terminate instance {{(pid=120616) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:31:22.147852 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-a4c59a90-4dec-4c11-b2c3-5fccee546b65 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 204 len: 0 microversion: 2.1 time: 0.133728 Sep 10 14:31:22.148601 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 655/1312] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:31:22 2022] DELETE /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:31:22.158326 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:22.159046 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:22.165322 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:22.165523 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [req-677db2e0-f3a7-468b-a757-9cd772bc4b65 req-263a9df2-4180-4883-844e-172eafcaa2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62", "tag": "709c4260-99eb-4169-b1f4-c828ecc332b7"}]} {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:31:22.165976 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:22.166416 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:22.167113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:22.167592 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:22.168656 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:22.176498 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-677db2e0-f3a7-468b-a757-9cd772bc4b65 req-263a9df2-4180-4883-844e-172eafcaa2d3 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:22.177107 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-677db2e0-f3a7-468b-a757-9cd772bc4b65 req-263a9df2-4180-4883-844e-172eafcaa2d3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:22.177539 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [req-677db2e0-f3a7-468b-a757-9cd772bc4b65 req-263a9df2-4180-4883-844e-172eafcaa2d3 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:22.188817 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.compute.server_external_events [req-677db2e0-f3a7-468b-a757-9cd772bc4b65 req-263a9df2-4180-4883-844e-172eafcaa2d3 service nova] Creating event network-changed:709c4260-99eb-4169-b1f4-c828ecc332b7 for instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 on hv-cinder-85690 Sep 10 14:31:22.194238 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [req-677db2e0-f3a7-468b-a757-9cd772bc4b65 req-263a9df2-4180-4883-844e-172eafcaa2d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177836 Sep 10 14:31:22.195163 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 658/1313] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:31:22.309941 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:31:22.317793 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b261a8cf-0275-4dee-afdb-4cd2832e97bc tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1578 microversion: 2.1 time: 0.163791 Sep 10 14:31:22.318355 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 656/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:22 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:31:23.342565 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:23.343189 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:23.349760 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:23.350237 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:23.350666 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:23.351348 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:23.351838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:23.352260 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:23.542911 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:31:23.550633 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-75bb806a-7fb9-43ea-ab72-d39b090c50f0 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1578 microversion: 2.1 time: 0.213333 Sep 10 14:31:23.551204 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 659/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:23 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:31:24.507501 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-94299217-e432-4cd2-94c7-2c8e3b092785 req-95673806-2d2e-485b-9ed4-7bf6bc57a5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62", "name": "network-vif-deleted", "tag": "709c4260-99eb-4169-b1f4-c828ecc332b7"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:31:24.518107 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-94299217-e432-4cd2-94c7-2c8e3b092785 req-95673806-2d2e-485b-9ed4-7bf6bc57a5f2 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:24.518578 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-94299217-e432-4cd2-94c7-2c8e3b092785 req-95673806-2d2e-485b-9ed4-7bf6bc57a5f2 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:24.519010 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-94299217-e432-4cd2-94c7-2c8e3b092785 req-95673806-2d2e-485b-9ed4-7bf6bc57a5f2 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:24.530189 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-94299217-e432-4cd2-94c7-2c8e3b092785 req-95673806-2d2e-485b-9ed4-7bf6bc57a5f2 service nova] Creating event network-vif-deleted:709c4260-99eb-4169-b1f4-c828ecc332b7 for instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 on hv-cinder-85690 Sep 10 14:31:24.535209 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-94299217-e432-4cd2-94c7-2c8e3b092785 req-95673806-2d2e-485b-9ed4-7bf6bc57a5f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031401 Sep 10 14:31:24.536037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 657/1316] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:31:24.573849 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:24.574470 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:24.580994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:24.581480 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:24.581918 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:24.582611 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:24.583065 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:24.583513 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:24.650588 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:31:24.658266 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-ad8e02c7-70b6-4a2d-a0b9-b76313e521f1 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 200 len: 1225 microversion: 2.1 time: 0.089121 Sep 10 14:31:24.658838 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 660/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:24 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:31:25.682449 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:25.683149 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:25.689310 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:25.689783 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:25.690210 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:25.690887 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:25.691336 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:25.691779 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:25.705570 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] HTTP exception thrown: Instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 could not be found. Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Request method failure captured: Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 HTTP/1.1 Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ2sbT8Z1oxXBi728b2_lCVUiZkrhM6Xp87bQnwFQkFi5gFa-3Ax-yhDYNppRLWdv93-2lI8LR2vb76mPn_pRYcX9yOn6NkYp-N27Tl6xSxjRz8hRkapGMG9kOO4tFVXFaFYxu8l90AzONkM6tc90PhMRPOjCfz_icX3tZDubXH5wO0 Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:31:25.707154 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8d41b873ac94a33beb63a2d89a218ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}] Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: f4638a1936f5467db502bda82320b113 Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 could not be found. Sep 10 14:31:25.709075 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62'} Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 could not be found. Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:31:25.710083 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 could not be found. Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 could not be found. Sep 10 14:31:25.711867 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:25.714124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Returning 404 to user: Instance 0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:31:25.714124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-8a72fb09-b2bc-42b1-846c-c1760606f60f tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62" status: 404 len: 111 microversion: 2.1 time: 0.031198 Sep 10 14:31:25.714124 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 658/1318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:25 2022] GET /compute/v2.1/servers/0b6c463b-1f44-4d42-a0b3-ad1d45b6fb62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:31:28.793295 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:28.793873 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:28.800499 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:28.800997 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:28.801442 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:28.801806 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-d609d36a-646b-448a-9f78-bb835d687a9b req-48b49f96-0a36-4b9b-bde7-33f5986ecf49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b68cfc6-292f-49e9-a776-67ac48b23b02", "tag": "e01064b1-7435-4e22-9852-af824ce7165c"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:31:28.802257 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:28.802591 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:28.803025 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:28.812244 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d609d36a-646b-448a-9f78-bb835d687a9b req-48b49f96-0a36-4b9b-bde7-33f5986ecf49 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:28.813182 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d609d36a-646b-448a-9f78-bb835d687a9b req-48b49f96-0a36-4b9b-bde7-33f5986ecf49 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:28.813610 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-d609d36a-646b-448a-9f78-bb835d687a9b req-48b49f96-0a36-4b9b-bde7-33f5986ecf49 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:28.828173 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-d609d36a-646b-448a-9f78-bb835d687a9b req-48b49f96-0a36-4b9b-bde7-33f5986ecf49 service nova] Creating event network-changed:e01064b1-7435-4e22-9852-af824ce7165c for instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 on hv-cinder-85690 Sep 10 14:31:28.831313 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Going to try to terminate instance {{(pid=120617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 14:31:28.833586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-d609d36a-646b-448a-9f78-bb835d687a9b req-48b49f96-0a36-4b9b-bde7-33f5986ecf49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035370 Sep 10 14:31:28.834500 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 659/1319] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 14:31:28.924584 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-64c2d96f-8220-49fc-af49-f0b1a81bec29 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 204 len: 0 microversion: 2.1 time: 0.135180 Sep 10 14:31:28.925904 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 661/1320] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:31:28 2022] DELETE /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 14:31:28.936051 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:28.936751 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:28.942869 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:28.943342 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:28.944011 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:28.944921 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:28.945370 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:28.945789 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:29.085853 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.policy [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120616) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:31:29.095531 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-34b4ffb8-aeab-4529-a9dd-2d5283105554 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1577 microversion: 2.1 time: 0.164612 Sep 10 14:31:29.096782 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 660/1321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:28 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:31:30.121211 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:30.121919 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:30.127889 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:30.128371 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:30.128808 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:30.129496 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:30.129950 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:30.130391 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:30.262994 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:31:30.270760 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-13ddc848-d111-4d05-9047-c9684dc7301c tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1577 microversion: 2.1 time: 0.154729 Sep 10 14:31:30.271324 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 662/1322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:30 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:31:31.239375 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [req-374cb57a-180b-4605-88d2-cd604d615dc0 req-3f1dc42c-0554-4526-a732-304ba055f302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b68cfc6-292f-49e9-a776-67ac48b23b02", "name": "network-vif-deleted", "tag": "e01064b1-7435-4e22-9852-af824ce7165c"}]} {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 14:31:31.249849 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-374cb57a-180b-4605-88d2-cd604d615dc0 req-3f1dc42c-0554-4526-a732-304ba055f302 service nova] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:31.250331 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-374cb57a-180b-4605-88d2-cd604d615dc0 req-3f1dc42c-0554-4526-a732-304ba055f302 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:31.250785 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [req-374cb57a-180b-4605-88d2-cd604d615dc0 req-3f1dc42c-0554-4526-a732-304ba055f302 service nova] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:31.262642 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.compute.server_external_events [req-374cb57a-180b-4605-88d2-cd604d615dc0 req-3f1dc42c-0554-4526-a732-304ba055f302 service nova] Creating event network-vif-deleted:e01064b1-7435-4e22-9852-af824ce7165c for instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 on hv-cinder-85690 Sep 10 14:31:31.267692 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [req-374cb57a-180b-4605-88d2-cd604d615dc0 req-3f1dc42c-0554-4526-a732-304ba055f302 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Sep 10 14:31:31.268412 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 661/1323] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 10 14:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 14:31:31.295434 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:31.296048 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:31.303613 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:31.304272 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:31.304663 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:31.305427 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:31.306518 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:31.306940 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:31.376834 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.policy [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4638a1936f5467db502bda82320b113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d41b873ac94a33beb63a2d89a218ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 14:31:31.385290 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-15c671ab-ff17-44fe-95ed-af5f08103dab tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 200 len: 1225 microversion: 2.1 time: 0.094966 Sep 10 14:31:31.386083 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 663/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:31 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 14:31:32.410286 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:32.410912 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 0b68cfc6-292f-49e9-a776-67ac48b23b02] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:32.417632 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:32.418113 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:32.418558 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:32.419239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:32.419719 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:32.420147 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:32.434492 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] HTTP exception thrown: Instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 could not be found. Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Request method failure captured: Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 HTTP/1.1 Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ2sbT8Z1oxXBi728b2_lCVUiZkrhM6Xp87bQnwFQkFi5gFa-3Ax-yhDYNppRLWdv93-2lI8LR2vb76mPn_pRYcX9yOn6NkYp-N27Tl6xSxjRz8hRkapGMG9kOO4tFVXFaFYxu8l90AzONkM6tc90PhMRPOjCfz_icX3tZDubXH5wO0 Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:31:32.436176 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8d41b873ac94a33beb63a2d89a218ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}] Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: f4638a1936f5467db502bda82320b113 Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 could not be found. Sep 10 14:31:32.438005 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '0b68cfc6-292f-49e9-a776-67ac48b23b02'} Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 could not be found. Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:31:32.439239 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 could not be found. Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 could not be found. Sep 10 14:31:32.441786 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.443823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Returning 404 to user: Instance 0b68cfc6-292f-49e9-a776-67ac48b23b02 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:31:32.443823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-b9243ad4-46b8-4d95-aed1-7ed5cfe562ae tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02" status: 404 len: 111 microversion: 2.1 time: 0.032485 Sep 10 14:31:32.443823 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 662/1325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:32 2022] GET /compute/v2.1/servers/0b68cfc6-292f-49e9-a776-67ac48b23b02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:31:32.875912 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:32.876398 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.compute.api [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:32.882847 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:32.883329 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:32.883824 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:32.884515 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:32.884967 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:32.885390 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG oslo_concurrency.lockutils [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:32.898567 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.wsgi [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] HTTP exception thrown: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Request method failure captured: Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: request: DELETE /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 HTTP/1.1 Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept: application/json Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Accept-Encoding: identity Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Connection: close Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Length: 0 Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Content-Type: application/json Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Host: 10.222.0.26 Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: Openstack-System-Scope: None Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: User-Agent: python-urllib3/1.26.12 Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Auth-Token: gAAAAABjHJ2sbT8Z1oxXBi728b2_lCVUiZkrhM6Xp87bQnwFQkFi5gFa-3Ax-yhDYNppRLWdv93-2lI8LR2vb76mPn_pRYcX9yOn6NkYp-N27Tl6xSxjRz8hRkapGMG9kOO4tFVXFaFYxu8l90AzONkM6tc90PhMRPOjCfz_icX3tZDubXH5wO0 Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Id: None Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Domain-Name: None Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Identity-Status: Confirmed Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Is-Admin-Project: True Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Id: default Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Domain-Name: Default Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Project-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Role: reader,member Sep 10 14:31:32.900874 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Roles: reader,member Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8d41b873ac94a33beb63a2d89a218ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}] Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-Tenant-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Id: default Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Domain-Name: Default Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Id: f4638a1936f5467db502bda82320b113 Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: X-User-Name: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: method: > Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: exception: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.902652 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: action_args: {'id': '7469fb7b-1361-4524-9eba-6ef556a22815'} Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:31:32.903648 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.905131 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.906600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Returning 404 to user: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. {{(pid=120617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:31:32.906600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-4fd142d1-00d2-4345-8f15-80cdce0f5354 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 404 len: 111 microversion: 2.1 time: 0.030177 Sep 10 14:31:32.906600 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 664/1326] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 10 14:31:32 2022] DELETE /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:31:32.910797 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '>' {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:32.911402 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.compute.api [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] [instance: 7469fb7b-1361-4524-9eba-6ef556a22815] Fetching instance by UUID {{(pid=120616) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 14:31:32.917947 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:32.918446 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:32.918877 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:32.919586 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Acquiring lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 14:31:32.920037 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 14:31:32.920450 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG oslo_concurrency.lockutils [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Lock "ab3df0e3-6de0-42ba-8be2-84cbff7aa19d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 14:31:32.933879 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.wsgi [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] HTTP exception thrown: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Request method failure captured: Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: request: GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 HTTP/1.1 Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept: application/json Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Accept-Encoding: identity Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Connection: close Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Length: 0 Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Content-Type: application/json Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Host: 10.222.0.26 Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: Openstack-System-Scope: None Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: User-Agent: python-urllib3/1.26.12 Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Auth-Token: gAAAAABjHJ2sbT8Z1oxXBi728b2_lCVUiZkrhM6Xp87bQnwFQkFi5gFa-3Ax-yhDYNppRLWdv93-2lI8LR2vb76mPn_pRYcX9yOn6NkYp-N27Tl6xSxjRz8hRkapGMG9kOO4tFVXFaFYxu8l90AzONkM6tc90PhMRPOjCfz_icX3tZDubXH5wO0 Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Id: None Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Domain-Name: None Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Identity-Status: Confirmed Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Is-Admin-Project: True Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Id: default Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Domain-Name: Default Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Project-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Role: reader,member Sep 10 14:31:32.935296 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Roles: reader,member Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8d41b873ac94a33beb63a2d89a218ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8d41b873ac94a33beb63a2d89a218ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d41b873ac94a33beb63a2d89a218ff"}]}] Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Id: c8d41b873ac94a33beb63a2d89a218ff Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1086013633 Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Id: default Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Domain-Name: Default Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Id: f4638a1936f5467db502bda82320b113 Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: X-User-Name: tempest-TestVolumeBootPattern-1086013633-project Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: method: > Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: exception: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.937095 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: action_args: {'id': '7469fb7b-1361-4524-9eba-6ef556a22815'} Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: {{(pid=120616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 14:31:32.938019 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. Sep 10 14:31:32.939649 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: ERROR nova.api.openstack.wsgi Sep 10 14:31:32.941135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: DEBUG nova.api.openstack.wsgi [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Returning 404 to user: Instance 7469fb7b-1361-4524-9eba-6ef556a22815 could not be found. {{(pid=120616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 14:31:32.941135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: INFO nova.api.openstack.requestlog [None req-3b1b5091-131d-4f60-b007-7346a6cd77f4 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815" status: 404 len: 111 microversion: 2.1 time: 0.029748 Sep 10 14:31:32.941135 dv-cinder-856901-1-iscsi devstack@n-api.service[120616]: [pid: 120616|app: 0|req: 663/1327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 10 14:31:32 2022] GET /compute/v2.1/servers/7469fb7b-1361-4524-9eba-6ef556a22815 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 14:31:34.234401 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: DEBUG nova.api.openstack.wsgi [None req-2e7948b7-1b99-4f82-9d0d-309d785a1467 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] Calling method '.version_select at 0x7ff6b6c1dca0>' {{(pid=120617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 14:31:34.254840 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: INFO nova.api.openstack.requestlog [None req-2e7948b7-1b99-4f82-9d0d-309d785a1467 tempest-TestVolumeBootPattern-1086013633 tempest-TestVolumeBootPattern-1086013633-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1666901075" status: 202 len: 0 microversion: 2.1 time: 0.024272 Sep 10 14:31:34.255423 dv-cinder-856901-1-iscsi devstack@n-api.service[120617]: [pid: 120617|app: 0|req: 665/1328] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 10 14:31:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1666901075 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)